Jul 03 16:06:07 devstack cinder-volume[75593]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 16:06:07 devstack cinder-volume[75593]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 16:06:07 devstack cinder-volume[75593]: we strongly recommend against using it for new projects. Jul 03 16:06:07 devstack cinder-volume[75593]: If you are already using Eventlet, we recommend migrating to a different Jul 03 16:06:07 devstack cinder-volume[75593]: framework. For more detail see Jul 03 16:06:07 devstack cinder-volume[75593]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 16:06:07 devstack cinder-volume[75593]: import eventlet # noqa Jul 03 16:06:10 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 16:06:10 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 16:06:10 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 16:06:11 devstack cinder-volume[75593]: INFO dbcounter [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Registered counter for database cinder Jul 03 16:06:11 devstack cinder-volume[75593]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:06:11 devstack cinder-volume[75593]: DEBUG dbcounter [-] [75593] Writer thread running {{(pid=75593) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 16:06:11 devstack cinder-volume[75593]: INFO cinder.rpc [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 16:06:11 devstack cinder-volume[75593]: INFO cinder.rpc [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 16:06:11 devstack cinder-volume[75593]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:06:11 devstack cinder-volume[75593]: INFO cinder.volume.manager [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Determined volume DB was empty at startup. Jul 03 16:06:11 devstack cinder-volume[75593]: DEBUG cinder.volume.manager [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75593) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 16:06:11 devstack cinder-volume[75593]: INFO cinder.volume.manager [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 16:06:11 devstack cinder-volume[75593]: WARNING stevedore.named [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 16:06:11 devstack cinder-volume[75593]: WARNING castellan.key_manager [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 16:06:11 devstack cinder-volume[75593]: WARNING cinder.keymgr.conf_key_mgr [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG cinder.volume.drivers.lvm [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75593) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_concurrency.processutils [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75593) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_concurrency.processutils [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] CMD "cinder-rtstool verify" returned: 0 in 0.587s {{(pid=75593) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:06:12 devstack cinder-volume[75593]: INFO cinder.rpc [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 16:06:12 devstack cinder-volume[75593]: INFO cinder.rpc [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 16:06:12 devstack cinder-volume[75593]: WARNING stevedore.named [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 16:06:12 devstack cinder-volume[75593]: WARNING castellan.key_manager [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 16:06:12 devstack cinder-volume[75593]: INFO cinder.volume.manager [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:06:12 devstack cinder-volume[75593]: INFO oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Starting 1 workers Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Started child 75758 {{(pid=75593) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Full set of CONF: {{(pid=75593) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] ******************************************************************************** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Configuration options gathered from: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 16:06:12 devstack cinder-volume[75758]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] ================================================================================ {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] allow_availability_zone_fallback = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] allow_compression_on_image_upload = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] allowed_direct_url_schemes = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] api_rate_limit = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] auth_strategy = keystone {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] az_cache_duration = 3600 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_availability_zone = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_host = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_stats_polling_interval = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backup_api_class = cinder.backup.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backup_name_template = backup-%s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backup_use_same_host = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backup_use_temp_snapshot = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] chap_password = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] chap_username = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cinder_internal_tenant_project_id = 71e2ef8c215642ab8b827989028e064f {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cinder_internal_tenant_user_id = 9d3b19c63d0d45e79ed7d8fd4313d152 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cloned_volume_same_az = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cluster = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] compression_format = gzip {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] compute_api_class = cinder.compute.nova.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] config_dir = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] config_source = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] control_exchange = openstack {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] debug = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] default_availability_zone = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] default_group_type = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] default_volume_type = lvmdriver-1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] disk_geometry = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] driver_client_cert = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] driver_client_cert_key = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] driver_data_namespace = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] driver_ssl_cert_path = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] driver_ssl_cert_verify = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] driver_use_ssl = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] enable_force_upload = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] enable_new_services = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] enable_unsupported_driver = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] enabled_backends = ['lvmdriver-1'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] enforce_multipath_for_image_xfer = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] filter_function = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_api_insecure = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_api_servers = ['http://192.168.122.197/image'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_api_ssl_compression = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_ca_certificates_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_catalog_info = image:glance:publicURL {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_keyfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_num_retries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance_request_timeout = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] goodness_function = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] graceful_shutdown_timeout = 5 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] group_api_class = cinder.group.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] host = devstack {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_compress_on_upload = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_conversion_address_space_limit = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_conversion_cpu_limit = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_conversion_disable = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_upload_use_cinder_backend = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_upload_use_internal_tenant = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_volume_cache_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_volume_cache_max_count = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] image_volume_cache_max_size_gb = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] init_host_max_objects_retrieval = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] instance_format = [instance: %(uuid)s] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] iscsi_target_flags = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] iscsi_write_cache = on {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] iser_helper = tgtadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] iser_ip_address = 192.168.122.197 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] iser_port = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] log_color = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] log_config_append = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] log_dir = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] log_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] log_options = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] log_rotate_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75758]: INFO cinder.volume.manager [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 03 16:06:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] log_rotate_interval_type = days {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] log_rotation_type = none {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] max_age = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] max_logfile_count = 30 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] max_logfile_size_mb = 200 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] max_over_subscription_ratio = 20.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] message_reap_interval = 86400 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] message_ttl = 2592000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] migration_create_volume_timeout_secs = 300 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] monkey_patch = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] monkey_patch_modules = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] my_ip = 192.168.122.197 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] no_snapshot_gb_quota = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] num_iser_scan_tries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] num_shell_tries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] num_volume_device_scan_tries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] nvmeof_conn_info_version = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] nvmet_ns_id = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] nvmet_port_id = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] osapi_max_limit = 1000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] osapi_volume_ext_list = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] osapi_volume_listen = 0.0.0.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] osapi_volume_listen_port = 8776 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] osapi_volume_use_ssl = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] osapi_volume_workers = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] per_volume_size_limit = -1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] periodic_fuzzy_delay = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] periodic_interval = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] project_id_regex = [0-9a-f\-]+ {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] public_endpoint = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] publish_errors = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] quota_backup_gigabytes = 1000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] quota_backups = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] quota_gigabytes = 1000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] quota_groups = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] quota_snapshots = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] quota_volumes = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] rate_limit_burst = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] rate_limit_except_level = CRITICAL {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] rate_limit_interval = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] reinit_driver_count = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] replication_device = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] report_discard_supported = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] report_interval = 120 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] reservation_clean_interval = 86400 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] reservation_expire = 86400 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] reserved_image_namespaces = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] reserved_percentage = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] rpc_response_timeout = 120 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] run_external_periodic_tasks = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] scst_target_driver = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] scst_target_iqn_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_down_time = 720 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] shell_completion = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] snapshot_name_template = snapshot-%s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] snapshot_same_host = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] split_loggers = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] state_path = /opt/stack/data/cinder {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] storage_availability_zone = nova {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] storage_protocol = iSCSI {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] syslog_log_facility = LOG_USER {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] target_helper = lioadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] target_ip_address = 192.168.122.197 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] target_port = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] target_protocol = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] target_secondary_ip_addresses = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] trace_flags = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] transfer_api_class = cinder.transfer.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] transport_url = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] until_refresh = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] use_chap_auth = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] use_default_quota_class = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] use_journal = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] use_json = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] use_multipath_for_image_xfer = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] use_stderr = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] use_syslog = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] verify_glance_signatures = enabled {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_api_class = cinder.volume.api.API {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_backend_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_clear = zero {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_clear_ionice = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_clear_size = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_copy_bps_limit = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_dd_blocksize = 1M {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_name_template = volume-%s {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_service_inithost_offload = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volume_usage_audit_period = month {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] zoning_mode = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_concurrency.disable_process_locking = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.auth_section = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.auth_type = password {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.auth_version = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.cache = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.delay_auth_decision = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:12 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.http_connect_timeout = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.include_service_catalog = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.insecure = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.interface = public {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.keyfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_password = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack sudo[75763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack sudo[75763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcache_username = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.region_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.service_token_roles_required = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.service_type = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.token_cache_time = 300 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.197/identity {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.backend = dogpile.cache.null {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.backend_argument = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.backend_expiration_time = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.config_prefix = cache.oslo {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.debug_cache_backend = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.enable_retry_client = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.enable_socket_keepalive = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.expiration_time = 600 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.hashclient_retry_attempts = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.memcache_dead_retry = 300 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.memcache_pool_maxsize = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.memcache_sasl_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.password = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.proxies = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.redis_db = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.redis_sentinel_service_name = mymaster {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.redis_server = localhost:6379 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.retry_attempts = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.retry_delay = 0.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.socket_keepalive_count = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.socket_keepalive_idle = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.socket_keepalive_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.socket_timeout = 1.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.tls_allowed_ciphers = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.tls_cafile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.tls_certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.tls_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.tls_keyfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cache.username = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] coordination.backend_url = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.asyncio_connection = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.asyncio_slave_connection = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.backend = sqlalchemy {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.connection = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.connection_debug = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.connection_parameters = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.connection_recycle_time = 3600 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.connection_trace = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.db_inc_retry_interval = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.db_max_retries = 20 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.db_max_retry_interval = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.db_retry_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.max_overflow = 50 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.max_pool_size = 5 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.max_retries = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.mysql_wsrep_sync_wait = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.pool_timeout = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.retry_interval = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.slave_connection = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.sqlite_synchronous = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.synchronous_reader = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] database.use_db_reconnect = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.connection_string = messaging:// {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.es_doc_type = notification {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.es_scroll_size = 10000 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.es_scroll_time = 2m {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.filter_error_trace = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.hmac_keys = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.sentinel_service_name = mymaster {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.socket_timeout = 0.1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.trace_requests = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler.trace_sqlalchemy = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler_jaeger.process_tags = {} {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler_jaeger.service_name_prefix = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] profiler_otlp.service_name_prefix = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.enforce_new_defaults = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.enforce_scope = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.policy_default_rule = default {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.policy_file = policy.yaml {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_policy.remote_timeout = 60.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] privsep_osbrick.group = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] privsep_osbrick.helper_command = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] privsep_osbrick.user = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cinder_sys_admin.group = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cinder_sys_admin.helper_command = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] cinder_sys_admin.user = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.auth_section = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.auth_type = password {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.cafile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.collect_timing = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.insecure = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.keyfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.send_service_user_token = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.split_loggers = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] service_user.timeout = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.auth_section = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.auth_type = password {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.collect_timing = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.insecure = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.keyfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.region_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.split_loggers = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] glance.timeout = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.backend_availability_zone = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.chap_password = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.chap_username = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.disk_geometry = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.driver_client_cert = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.driver_client_cert_key = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.driver_data_namespace = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.driver_use_ssl = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.enable_unsupported_driver = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.extra_capabilities = {} {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.filter_function = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.goodness_function = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.iscsi_target_flags = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.iscsi_write_cache = on {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.iser_helper = tgtadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.iser_ip_address = 192.168.122.197 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.iser_port = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.lvm_mirrors = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.lvm_share_target = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.lvm_type = auto {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.num_shell_tries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.nvmet_port_id = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.replication_device = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.report_discard_supported = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.reserved_percentage = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.scst_target_driver = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.scst_target_iqn_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.storage_protocol = iSCSI {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.target_helper = tgtadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.target_ip_address = 192.168.122.197 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.target_port = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.target_protocol = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.trace_flags = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.unique_fqdn_network = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.use_chap_auth = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volume_backend_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volume_clear = zero {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volume_clear_ionice = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volume_clear_size = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volume_group = cinder-volumes {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_reports.file_event_handler = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_reports.log_dir = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.backend_availability_zone = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.backend_host = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.chap_password = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.chap_username = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.chiscsi_conf = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.disk_geometry = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.driver_client_cert = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.driver_data_namespace = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.driver_use_ssl = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.extra_capabilities = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.filter_function = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.goodness_function = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.iser_helper = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.iser_ip_address = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.iser_port = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.iser_target_prefix = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.lvm_conf_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.lvm_mirrors = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.lvm_share_target = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.lvm_type = auto {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.num_shell_tries = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.nvmet_port_id = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.replication_device = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.report_discard_supported = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.reserved_percentage = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.scst_target_driver = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.storage_protocol = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.target_helper = lioadm {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.target_ip_address = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.target_port = 3260 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.target_protocol = iscsi {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.trace_flags = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.use_chap_auth = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volume_clear = zero {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volume_clear_size = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] lvmdriver-1.volumes_dir = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.ssl = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.ssl_version = {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_notifications.driver = [] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_notifications.retry = -1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] oslo_messaging_notifications.transport_url = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] key_manager.fixed_key = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.barbican_api_version = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.barbican_endpoint = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.barbican_endpoint_type = public {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.barbican_region_name = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.cafile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.collect_timing = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.insecure = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.keyfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.number_of_retries = 60 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.retry_delay = 1 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.send_service_user_token = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.split_loggers = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.timeout = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.verify_ssl = True {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican.verify_ssl_path = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican_service_user.auth_section = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican_service_user.auth_type = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican_service_user.cafile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican_service_user.certfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican_service_user.collect_timing = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican_service_user.insecure = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican_service_user.keyfile = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican_service_user.split_loggers = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] barbican_service_user.timeout = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.approle_role_id = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.approle_secret_id = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.kv_mountpoint = secret {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.kv_path = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.kv_version = 2 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.namespace = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.root_token_id = **** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.ssl_ca_crt_file = None {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.timeout = 60.0 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.use_ssl = False {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:06:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] ******************************************************************************** {{(pid=75593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 16:06:13 devstack sudo[75763]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:13 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.710s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:13 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:13 devstack sudo[75843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:06:13 devstack sudo[75843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:14 devstack sudo[75843]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:14 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.685s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:14 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:06:14 devstack cinder-volume[75758]: INFO cinder.brick.local_dev.lvm [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 03 16:06:14 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:14 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:14 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:14 devstack sudo[76086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:06:14 devstack sudo[76086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:15 devstack sudo[76086]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:15 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:15 devstack cinder-volume[75758]: DEBUG cinder.brick.local_dev.lvm [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75758) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 03 16:06:15 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:15 devstack sudo[76279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:06:15 devstack sudo[76279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:16 devstack sudo[76279]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:16 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.460s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:16 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:16 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:16 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:16 devstack sudo[76537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:06:16 devstack sudo[76537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:17 devstack sudo[76537]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:17 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.733s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:17 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:17 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:17 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:17 devstack sudo[76542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 03 16:06:17 devstack sudo[76542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:17 devstack sudo[76542]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:18 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.683s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:18 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:18 devstack sudo[76546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:06:18 devstack sudo[76546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:18 devstack sudo[76546]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:18 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.837s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:18 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:18 devstack sudo[76556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:06:18 devstack sudo[76556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:19 devstack sudo[76556]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:19 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.798s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:19 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:19 devstack sudo[76561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:06:19 devstack sudo[76561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:20 devstack sudo[76561]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:20 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.892s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:20 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:20 devstack sudo[76568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:06:20 devstack sudo[76568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:21 devstack sudo[76568]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:21 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.777s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:21 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:21 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:21 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:21 devstack sudo[76576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:06:21 devstack sudo[76576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:22 devstack sudo[76576]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:22 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.835s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:22 devstack cinder-volume[75758]: INFO cinder.volume.drivers.lvm [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 03 16:06:22 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:22 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:22 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:22 devstack sudo[76614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:06:22 devstack sudo[76614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:22 devstack cinder-volume[75593]: DEBUG dbcounter [-] [75593] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75593) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:06:22 devstack sudo[76614]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:22 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.684s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:22 devstack cinder-volume[75758]: DEBUG cinder.volume.drivers.lvm [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Updating volume stats {{(pid=75758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 16:06:22 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:22 devstack sudo[76703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:06:22 devstack sudo[76703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:23 devstack sudo[76703]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:23 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:23 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:23 devstack sudo[76843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:06:23 devstack sudo[76843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:24 devstack sudo[76843]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:24 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:24 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:24 devstack sudo[76847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:06:24 devstack sudo[76847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:24 devstack sudo[76847]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:24 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:24 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:24 devstack sudo[76851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:06:24 devstack sudo[76851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:25 devstack sudo[76851]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:25 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:25 devstack cinder-volume[75758]: INFO cinder.volume.driver [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Driver hasn't implemented _init_vendor_properties() Jul 03 16:06:25 devstack cinder-volume[75758]: DEBUG cinder.volume.driver [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75758) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 16:06:25 devstack cinder-volume[75758]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:06:25 devstack cinder-volume[75758]: DEBUG dbcounter [-] [75758] Writer thread running {{(pid=75758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 16:06:25 devstack cinder-volume[75758]: DEBUG cinder.db.api [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Building query based on filter {{(pid=75758) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 16:06:25 devstack cinder-volume[75758]: DEBUG cinder.image.image_utils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75758) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 16:06:25 devstack cinder-volume[75758]: INFO cinder.keymgr.migration [None req-f575ccb9-00c9-406c-b750-92fa7a9da755 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 16:06:25 devstack cinder-volume[75758]: DEBUG cinder.volume.drivers.lvm [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Updating volume stats {{(pid=75758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 16:06:25 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:25 devstack sudo[76855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:06:25 devstack sudo[76855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:26 devstack sudo[76855]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:26 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.736s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:26 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:26 devstack sudo[76862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:06:26 devstack sudo[76862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:27 devstack sudo[76862]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:27 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:27 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:27 devstack sudo[76871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:06:27 devstack sudo[76871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:27 devstack sudo[76871]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:27 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.680s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:27 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:27 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:06:27 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:28 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:28 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:28 devstack cinder-volume[75758]: DEBUG cinder.manager [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Notifying Schedulers of capabilities ... {{(pid=75758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:06:28 devstack cinder-volume[75758]: INFO cinder.volume.manager [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Driver initialization completed successfully. Jul 03 16:06:28 devstack cinder-volume[75758]: INFO cinder.manager [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Initiating service 2 cleanup Jul 03 16:06:28 devstack cinder-volume[75758]: INFO cinder.manager [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Service 2 cleanup completed. Jul 03 16:06:28 devstack cinder-volume[75758]: DEBUG cinder.service [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Creating RPC server for service cinder-volume {{(pid=75758) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 16:06:28 devstack cinder-volume[75758]: DEBUG cinder.service [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75758) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 16:06:28 devstack cinder-volume[75758]: INFO cinder.volume.manager [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 03 16:06:28 devstack cinder-volume[75758]: DEBUG cinder.volume.drivers.lvm [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Updating volume stats {{(pid=75758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 16:06:28 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:28 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:06:28 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:29 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:29 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:29 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:29 devstack sudo[76885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:06:29 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:30 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:30 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:30 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:30 devstack sudo[76942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:06:30 devstack sudo[76942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:30 devstack sudo[76942]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:30 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:30 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:06:30 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:06:30 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:06:31 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Jul 03 16:06:31 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:06:31 devstack cinder-volume[75758]: INFO cinder.volume.manager [None req-bbc1057e-6bfe-4786-a475-10303481c1ca None None] Driver post RPC initialization completed successfully. Jul 03 16:06:41 devstack cinder-volume[75758]: DEBUG dbcounter [-] [75758] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:06:41 devstack cinder-volume[75758]: DEBUG dbcounter [-] [75758] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:07:10 devstack cinder-volume[75758]: DEBUG oslo_service.periodic_task [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running periodic task VolumeManager._thread_info {{(pid=75758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:07:10 devstack cinder-volume[75758]: DEBUG cinder.volume.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] thread count: 6 {{(pid=75758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:07:10 devstack cinder-volume[75758]: DEBUG cinder.volume.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] thread info: [<_MainThread(MainThread, started 132862782492800)>, , , , , ] {{(pid=75758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:08:10 devstack cinder-volume[75758]: DEBUG oslo_service.periodic_task [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:08:10 devstack cinder-volume[75758]: DEBUG cinder.volume.drivers.lvm [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Updating volume stats {{(pid=75758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 16:08:10 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:08:10 devstack sudo[79308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:08:10 devstack sudo[79308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:08:11 devstack sudo[79308]: pam_unix(sudo:session): session closed for user root Jul 03 16:08:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:08:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:08:11 devstack sudo[79311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:08:11 devstack sudo[79311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:08:11 devstack sudo[79311]: pam_unix(sudo:session): session closed for user root Jul 03 16:08:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:08:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:08:11 devstack sudo[79314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:08:11 devstack sudo[79314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:08:12 devstack sudo[79314]: pam_unix(sudo:session): session closed for user root Jul 03 16:08:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:08:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:08:12 devstack sudo[79317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:08:12 devstack sudo[79317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:08:13 devstack sudo[79317]: pam_unix(sudo:session): session closed for user root Jul 03 16:08:13 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:08:13 devstack cinder-volume[75758]: DEBUG cinder.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Notifying Schedulers of capabilities ... {{(pid=75758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:08:13 devstack cinder-volume[75758]: DEBUG oslo_service.periodic_task [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running periodic task VolumeManager._thread_info {{(pid=75758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:08:13 devstack cinder-volume[75758]: DEBUG cinder.volume.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] thread count: 6 {{(pid=75758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:08:13 devstack cinder-volume[75758]: DEBUG cinder.volume.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] thread info: [<_MainThread(MainThread, started 132862782492800)>, , , , , ] {{(pid=75758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:08:41 devstack cinder-volume[75758]: DEBUG dbcounter [-] [75758] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:09:10 devstack cinder-volume[75758]: DEBUG oslo_service.periodic_task [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:09:10 devstack cinder-volume[75758]: DEBUG cinder.volume.drivers.lvm [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Updating volume stats {{(pid=75758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 16:09:10 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:09:10 devstack sudo[82554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:09:10 devstack sudo[82554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:09:11 devstack sudo[82554]: pam_unix(sudo:session): session closed for user root Jul 03 16:09:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:09:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:09:11 devstack sudo[82576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:09:11 devstack sudo[82576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:09:11 devstack sudo[82576]: pam_unix(sudo:session): session closed for user root Jul 03 16:09:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:09:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:09:11 devstack sudo[82863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:09:11 devstack sudo[82863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:09:12 devstack sudo[82863]: pam_unix(sudo:session): session closed for user root Jul 03 16:09:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:09:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:09:12 devstack sudo[82937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:09:12 devstack sudo[82937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:09:13 devstack sudo[82937]: pam_unix(sudo:session): session closed for user root Jul 03 16:09:13 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:09:13 devstack cinder-volume[75758]: DEBUG cinder.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Notifying Schedulers of capabilities ... {{(pid=75758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:09:13 devstack cinder-volume[75758]: DEBUG oslo_service.periodic_task [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running periodic task VolumeManager._thread_info {{(pid=75758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:09:13 devstack cinder-volume[75758]: DEBUG cinder.volume.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] thread count: 6 {{(pid=75758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:09:13 devstack cinder-volume[75758]: DEBUG cinder.volume.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] thread info: [<_MainThread(MainThread, started 132862782492800)>, , , , , ] {{(pid=75758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:10:10 devstack cinder-volume[75758]: DEBUG oslo_service.periodic_task [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:10:10 devstack cinder-volume[75758]: DEBUG cinder.volume.drivers.lvm [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Updating volume stats {{(pid=75758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 16:10:10 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:10:10 devstack sudo[84539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:10:10 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:10:11 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root Jul 03 16:10:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:10:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:10:11 devstack sudo[84553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:10:11 devstack sudo[84553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:10:11 devstack sudo[84553]: pam_unix(sudo:session): session closed for user root Jul 03 16:10:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:10:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:10:11 devstack sudo[84571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:10:11 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:10:12 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root Jul 03 16:10:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:10:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:10:12 devstack sudo[84611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:10:12 devstack sudo[84611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:10:13 devstack sudo[84611]: pam_unix(sudo:session): session closed for user root Jul 03 16:10:13 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:10:13 devstack cinder-volume[75758]: DEBUG cinder.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Notifying Schedulers of capabilities ... {{(pid=75758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:10:41 devstack cinder-volume[75758]: DEBUG dbcounter [-] [75758] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:11:10 devstack cinder-volume[75758]: DEBUG oslo_service.periodic_task [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:11:10 devstack cinder-volume[75758]: DEBUG cinder.volume.drivers.lvm [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Updating volume stats {{(pid=75758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 16:11:10 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:10 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 16:11:10 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:11 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:11 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:11:11 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:11 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:11 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:11 devstack sudo[85779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 16:11:11 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:12 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:12 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:12 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 16:11:12 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:13 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:13 devstack cinder-volume[75758]: DEBUG oslo_concurrency.processutils [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:13 devstack cinder-volume[75758]: DEBUG cinder.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Notifying Schedulers of capabilities ... {{(pid=75758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:11:13 devstack cinder-volume[75758]: DEBUG oslo_service.periodic_task [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] Running periodic task VolumeManager._thread_info {{(pid=75758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:11:13 devstack cinder-volume[75758]: DEBUG cinder.volume.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] thread count: 6 {{(pid=75758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:11:13 devstack cinder-volume[75758]: DEBUG cinder.volume.manager [None req-1dfb26bd-5472-42ec-9eec-d9dcb440cdbb None None] thread info: [<_MainThread(MainThread, started 132862782492800)>, , , , , ] {{(pid=75758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:11:13 devstack cinder-volume[75593]: INFO oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Caught SIGTERM, stopping children Jul 03 16:11:13 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Acquiring lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 16:11:13 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Acquired lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 16:11:13 devstack cinder-volume[75593]: DEBUG oslo_concurrency.lockutils [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Releasing lock "singleton_lock" {{(pid=75593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 16:11:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Stop services. {{(pid=75593) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 16:11:13 devstack cinder-volume[75593]: DEBUG oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Killing children. {{(pid=75593) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 16:11:13 devstack cinder-volume[75593]: INFO oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Waiting on 1 children to exit Jul 03 16:11:13 devstack cinder-volume[75758]: DEBUG oslo_concurrency.lockutils [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Acquiring lock "singleton_lock" {{(pid=75758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 16:11:13 devstack cinder-volume[75758]: DEBUG oslo_concurrency.lockutils [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Acquired lock "singleton_lock" {{(pid=75758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 16:11:13 devstack cinder-volume[75758]: DEBUG oslo_concurrency.lockutils [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Releasing lock "singleton_lock" {{(pid=75758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 16:11:13 devstack cinder-volume[75758]: WARNING amqp [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 16:11:13 devstack cinder-volume[75758]: WARNING amqp [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 16:11:13 devstack cinder-volume[75593]: INFO oslo_service.backend._eventlet.service [None req-e8ad8222-8097-4c9a-9fc3-d15df2e16bec None None] Child 75758 exited with status 0 Jul 03 16:11:14 devstack cinder-volume[85897]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 16:11:14 devstack cinder-volume[85897]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 16:11:14 devstack cinder-volume[85897]: we strongly recommend against using it for new projects. Jul 03 16:11:14 devstack cinder-volume[85897]: If you are already using Eventlet, we recommend migrating to a different Jul 03 16:11:14 devstack cinder-volume[85897]: framework. For more detail see Jul 03 16:11:14 devstack cinder-volume[85897]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 16:11:14 devstack cinder-volume[85897]: import eventlet # noqa Jul 03 16:11:16 devstack cinder-volume[85897]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85897) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 16:11:16 devstack cinder-volume[85897]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85897) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 16:11:16 devstack cinder-volume[85897]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85897) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 16:11:16 devstack cinder-volume[85897]: INFO dbcounter [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Registered counter for database cinder Jul 03 16:11:16 devstack cinder-volume[85897]: DEBUG oslo_db.sqlalchemy.engines [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85897) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG dbcounter [-] [85897] Writer thread running {{(pid=85897) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 16:11:17 devstack cinder-volume[85897]: INFO cinder.rpc [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 16:11:17 devstack cinder-volume[85897]: INFO cinder.rpc [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_db.sqlalchemy.engines [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85897) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:11:17 devstack cinder-volume[85897]: INFO cinder.volume.manager [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Determined volume DB was empty at startup. Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG cinder.volume.manager [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85897) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 16:11:17 devstack cinder-volume[85897]: INFO cinder.volume.manager [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 16:11:17 devstack cinder-volume[85897]: WARNING stevedore.named [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 16:11:17 devstack cinder-volume[85897]: WARNING castellan.key_manager [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 16:11:17 devstack cinder-volume[85897]: WARNING cinder.keymgr.conf_key_mgr [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 16:11:17 devstack cinder-volume[85897]: INFO cinder.volume.manager [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_db.sqlalchemy.engines [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85897) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:11:17 devstack cinder-volume[85897]: INFO oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Starting 1 workers Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Started child 86112 {{(pid=85897) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Full set of CONF: {{(pid=85897) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] ******************************************************************************** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Configuration options gathered from: {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] ================================================================================ {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] allow_availability_zone_fallback = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] allow_compression_on_image_upload = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] allowed_direct_url_schemes = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] api_rate_limit = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] auth_strategy = keystone {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_availability_zone = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_host = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_stats_polling_interval = 60 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backup_api_class = cinder.backup.api.API {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backup_name_template = backup-%s {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backup_use_same_host = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backup_use_temp_snapshot = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[86112]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] chap_password = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] chap_username = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cinder_internal_tenant_project_id = 71e2ef8c215642ab8b827989028e064f {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cinder_internal_tenant_user_id = 9d3b19c63d0d45e79ed7d8fd4313d152 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cluster = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] compression_format = gzip {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] compute_api_class = cinder.compute.nova.API {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] config_dir = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] config_source = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] control_exchange = openstack {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] debug = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] default_availability_zone = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] default_group_type = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] default_volume_type = QuobyteHD {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] disk_geometry = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] driver_client_cert = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] driver_client_cert_key = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] driver_data_namespace = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] driver_ssl_cert_path = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] driver_ssl_cert_verify = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] driver_use_ssl = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] enable_new_services = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] enable_unsupported_driver = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] enabled_backends = ['QuobyteHD'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] enforce_multipath_for_image_xfer = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] filter_function = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_api_insecure = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_api_servers = ['http://192.168.122.197/image'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_api_ssl_compression = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_ca_certificates_file = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_catalog_info = image:glance:publicURL {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_certfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_keyfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_num_retries = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance_request_timeout = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] goodness_function = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[86112]: INFO cinder.volume.manager [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 16:11:17 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.remotefs [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86112) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] graceful_shutdown_timeout = 5 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] group_api_class = cinder.group.api.API {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] host = devstack {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_compress_on_upload = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_conversion_address_space_limit = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_conversion_cpu_limit = 60 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_conversion_disable = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_upload_use_cinder_backend = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_upload_use_internal_tenant = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_volume_cache_enabled = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_volume_cache_max_count = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] image_volume_cache_max_size_gb = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] init_host_max_objects_retrieval = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] instance_format = [instance: %(uuid)s] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] iscsi_target_flags = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] iscsi_write_cache = on {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] iser_helper = tgtadm {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] iser_ip_address = 192.168.122.197 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] iser_port = 3260 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] log_color = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] log_config_append = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] log_dir = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] log_file = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] log_options = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] log_rotate_interval = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] log_rotate_interval_type = days {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] log_rotation_type = none {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] max_age = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] max_logfile_count = 30 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] max_logfile_size_mb = 200 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] max_over_subscription_ratio = 20.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] message_reap_interval = 86400 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] message_ttl = 2592000 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] migration_create_volume_timeout_secs = 300 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] monkey_patch = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] monkey_patch_modules = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] my_ip = 192.168.122.197 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] no_snapshot_gb_quota = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] num_iser_scan_tries = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] num_shell_tries = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] num_volume_device_scan_tries = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] nvmeof_conn_info_version = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] nvmet_ns_id = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] nvmet_port_id = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] osapi_max_limit = 1000 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] osapi_volume_ext_list = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] osapi_volume_listen = 0.0.0.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] osapi_volume_listen_port = 8776 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] osapi_volume_use_ssl = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] osapi_volume_workers = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] per_volume_size_limit = -1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] periodic_fuzzy_delay = 60 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] periodic_interval = 60 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] project_id_regex = [0-9a-f\-]+ {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] public_endpoint = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] publish_errors = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] quota_backup_gigabytes = 1000 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] quota_backups = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] quota_gigabytes = 1000 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] quota_groups = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] quota_snapshots = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] quota_volumes = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] rate_limit_burst = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] rate_limit_except_level = CRITICAL {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] rate_limit_interval = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] reinit_driver_count = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] replication_device = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] report_discard_supported = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] report_interval = 120 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] reservation_clean_interval = 86400 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] reservation_expire = 86400 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] reserved_image_namespaces = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] reserved_percentage = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] rpc_response_timeout = 120 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] run_external_periodic_tasks = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] scst_target_driver = iscsi {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] scst_target_iqn_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_down_time = 720 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] shell_completion = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] snapshot_name_template = snapshot-%s {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] split_loggers = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] state_path = /opt/stack/data/cinder {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] storage_availability_zone = nova {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] storage_protocol = iSCSI {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] syslog_log_facility = LOG_USER {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] target_helper = lioadm {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] target_ip_address = 192.168.122.197 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] target_port = 3260 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] target_protocol = iscsi {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] target_secondary_ip_addresses = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] trace_flags = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] transfer_api_class = cinder.transfer.api.API {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] transport_url = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] until_refresh = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] use_chap_auth = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] use_default_quota_class = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] use_journal = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] use_json = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] use_multipath_for_image_xfer = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] use_stderr = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] use_syslog = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] verify_glance_signatures = enabled {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_api_class = cinder.volume.api.API {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_backend_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_clear = zero {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_clear_ionice = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_clear_size = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_copy_bps_limit = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_dd_blocksize = 1M {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_name_template = volume-%s {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_service_inithost_offload = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volume_usage_audit_period = month {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] zoning_mode = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_concurrency.disable_process_locking = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.auth_section = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.auth_type = password {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.auth_version = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.cache = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.certfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.include_service_catalog = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.insecure = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.interface = public {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.keyfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_password = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86112) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 16:11:17 devstack cinder-volume[86112]: WARNING cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 16:11:17 devstack cinder-volume[86112]: WARNING cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Running cmd (subprocess): mount.quobyte {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcache_username = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.region_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.service_token_roles_required = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.service_type = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.197/identity {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.backend = dogpile.cache.null {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.backend_argument = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.backend_expiration_time = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.config_prefix = cache.oslo {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.debug_cache_backend = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.enable_retry_client = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.enable_socket_keepalive = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.enabled = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.expiration_time = 600 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.hashclient_retry_attempts = 2 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.memcache_dead_retry = 300 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.memcache_pool_maxsize = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.memcache_sasl_enabled = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.password = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.proxies = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.redis_db = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.redis_server = localhost:6379 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.retry_attempts = 2 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.retry_delay = 0.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.socket_keepalive_count = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.socket_keepalive_idle = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.socket_keepalive_interval = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.socket_timeout = 1.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.tls_allowed_ciphers = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.tls_cafile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.tls_certfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.tls_enabled = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.tls_keyfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cache.username = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] coordination.backend_url = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.asyncio_connection = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.asyncio_slave_connection = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.backend = sqlalchemy {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.connection = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.connection_debug = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.connection_parameters = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.connection_recycle_time = 3600 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.connection_trace = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.db_inc_retry_interval = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.db_max_retries = 20 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.db_max_retry_interval = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.db_retry_interval = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.max_overflow = 50 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.max_pool_size = 5 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.max_retries = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.mysql_wsrep_sync_wait = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.pool_timeout = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.retry_interval = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.slave_connection = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.sqlite_synchronous = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.synchronous_reader = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] database.use_db_reconnect = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.connection_string = messaging:// {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.enabled = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.es_doc_type = notification {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.es_scroll_size = 10000 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.es_scroll_time = 2m {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.filter_error_trace = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.hmac_keys = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.sentinel_service_name = mymaster {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.socket_timeout = 0.1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.trace_requests = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler.trace_sqlalchemy = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler_jaeger.process_tags = {} {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler_jaeger.service_name_prefix = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] profiler_otlp.service_name_prefix = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.enforce_new_defaults = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.enforce_scope = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.policy_default_rule = default {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.policy_file = policy.yaml {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_policy.remote_timeout = 60.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] privsep_osbrick.group = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] privsep_osbrick.helper_command = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] privsep_osbrick.user = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cinder_sys_admin.group = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cinder_sys_admin.helper_command = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] cinder_sys_admin.user = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.auth_section = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.auth_type = password {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.cafile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.certfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.collect_timing = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.insecure = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.keyfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.send_service_user_token = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.split_loggers = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] service_user.timeout = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.auth_section = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.auth_type = password {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.certfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.collect_timing = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.insecure = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.keyfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.region_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.split_loggers = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] glance.timeout = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.backend_availability_zone = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.chap_password = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.chap_username = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.disk_geometry = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.driver_client_cert = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.driver_client_cert_key = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.driver_data_namespace = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.driver_use_ssl = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.extra_capabilities = {} {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.filter_function = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.goodness_function = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.iscsi_target_flags = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.iscsi_write_cache = on {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.iser_helper = tgtadm {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.iser_ip_address = 192.168.122.197 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.iser_port = 3260 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_host = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_login = admin {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_mount_options = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_password = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_private_key = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_share_path = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_ssh_port = 22 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.num_shell_tries = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.quobyte_client_cfg = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.quobyte_volume_url = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] CMD "mount.quobyte" returned: 1 in 0.109s {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.replication_device = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.report_discard_supported = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.reserved_percentage = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86112) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.target_helper = tgtadm {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.target_ip_address = 192.168.122.197 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[86112]: INFO cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 ... Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.target_port = 3260 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.target_protocol = iscsi {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.trace_flags = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.unique_fqdn_network = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.use_chap_auth = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.volume_backend_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 -c /etc/quobyte/client-cinder.cfg {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.volume_clear = zero {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.volume_clear_ionice = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.volume_clear_size = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_reports.file_event_handler = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_reports.log_dir = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.backend_availability_zone = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.backend_host = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.chap_password = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.chap_username = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.chiscsi_conf = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.disk_geometry = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.driver_client_cert = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.driver_client_cert_key = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.driver_data_namespace = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.driver_use_ssl = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.extra_capabilities = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.filter_function = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.goodness_function = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.iscsi_target_flags = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.iscsi_write_cache = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.iser_helper = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.iser_ip_address = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.iser_port = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.iser_target_prefix = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_host = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_login = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_mount_options = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_password = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_private_key = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_share_path = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_ssh_port = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.num_shell_tries = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nvmet_ns_id = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.nvmet_port_id = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.replication_device = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.report_discard_supported = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.reserved_percentage = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.scst_target_driver = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.storage_protocol = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.target_helper = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.target_ip_address = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.target_port = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.target_prefix = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.target_protocol = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.trace_flags = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.unique_fqdn_network = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.use_chap_auth = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.volume_clear = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.volume_clear_ionice = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.volume_clear_size = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] QuobyteHD.volumes_dir = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack sudo[86118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 -c /etc/quobyte/client-cinder.cfg Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:17 devstack sudo[86118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.ssl = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.ssl_version = {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_notifications.driver = [] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_notifications.retry = -1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] key_manager.fixed_key = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.barbican_api_version = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.barbican_endpoint = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.barbican_endpoint_type = public {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.barbican_region_name = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.cafile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.certfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.collect_timing = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.insecure = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.keyfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.number_of_retries = 60 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.retry_delay = 1 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.send_service_user_token = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.split_loggers = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.timeout = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.verify_ssl = True {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican.verify_ssl_path = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican_service_user.auth_section = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican_service_user.auth_type = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican_service_user.cafile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican_service_user.certfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican_service_user.collect_timing = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican_service_user.insecure = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican_service_user.keyfile = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican_service_user.split_loggers = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] barbican_service_user.timeout = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.approle_role_id = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.approle_secret_id = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.kv_mountpoint = secret {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.kv_path = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.kv_version = 2 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.namespace = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.root_token_id = **** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.ssl_ca_crt_file = None {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.timeout = 60.0 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.use_ssl = False {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:18 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] ******************************************************************************** {{(pid=85897) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 16:11:18 devstack sudo[86118]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:18 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.830s {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:18 devstack cinder-volume[86112]: INFO cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 succeeded Jul 03 16:11:18 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86112) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:11:18 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.846s {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:11:18 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:18 devstack sudo[86187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:11:18 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:19 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.649s {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:19 devstack cinder-volume[86112]: INFO cinder.volume.driver [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Driver hasn't implemented _init_vendor_properties() Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG cinder.volume.driver [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86112) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG oslo_db.sqlalchemy.engines [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86112) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG dbcounter [-] [86112] Writer thread running {{(pid=86112) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG cinder.db.api [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Building query based on filter {{(pid=86112) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG cinder.image.image_utils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86112) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 16:11:19 devstack cinder-volume[86112]: INFO cinder.keymgr.migration [None req-cd7f1a40-2dd4-46d9-88d2-3e3af0c1a872 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86112) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86112) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:11:19 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:19 devstack sudo[86191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:11:19 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:20 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.630s {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG cinder.manager [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Notifying Schedulers of capabilities ... {{(pid=86112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:11:20 devstack cinder-volume[86112]: INFO cinder.volume.manager [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Driver initialization completed successfully. Jul 03 16:11:20 devstack cinder-volume[86112]: INFO cinder.manager [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Initiating service 3 cleanup Jul 03 16:11:20 devstack cinder-volume[86112]: INFO cinder.manager [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Service 3 cleanup completed. Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG cinder.service [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Creating RPC server for service cinder-volume {{(pid=86112) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG cinder.service [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86112) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 16:11:20 devstack cinder-volume[86112]: INFO cinder.volume.manager [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86112) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.quobyte [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86112) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:11:20 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:20 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:11:20 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:21 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:21 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.649s {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:21 devstack cinder-volume[86112]: INFO cinder.volume.manager [None req-60c14f5a-5a01-4123-a002-30ff6c232b8a None None] Driver post RPC initialization completed successfully. Jul 03 16:11:25 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-0a31ca26-ea10-4706-86a8-800e9603b458 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:11:25 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-0a31ca26-ea10-4706-86a8-800e9603b458 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:11:25 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.quobyte [None req-0a31ca26-ea10-4706-86a8-800e9603b458 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86112) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:11:25 devstack cinder-volume[86112]: DEBUG cinder.volume.drivers.quobyte [None req-0a31ca26-ea10-4706-86a8-800e9603b458 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86112) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:11:25 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-0a31ca26-ea10-4706-86a8-800e9603b458 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86112) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:11:25 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-0a31ca26-ea10-4706-86a8-800e9603b458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:25 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:11:25 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:25 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:25 devstack cinder-volume[86112]: DEBUG oslo_concurrency.processutils [None req-0a31ca26-ea10-4706-86a8-800e9603b458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.614s {{(pid=86112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:25 devstack cinder-volume[86112]: DEBUG cinder.manager [None req-0a31ca26-ea10-4706-86a8-800e9603b458 None None] Notifying Schedulers of capabilities ... {{(pid=86112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:11:27 devstack cinder-volume[85897]: INFO oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Caught SIGTERM, stopping children Jul 03 16:11:27 devstack cinder-volume[85897]: DEBUG oslo_concurrency.lockutils [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Acquiring lock "singleton_lock" {{(pid=85897) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 16:11:27 devstack cinder-volume[85897]: DEBUG oslo_concurrency.lockutils [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Acquired lock "singleton_lock" {{(pid=85897) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 16:11:27 devstack cinder-volume[85897]: DEBUG oslo_concurrency.lockutils [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Releasing lock "singleton_lock" {{(pid=85897) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 16:11:27 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Stop services. {{(pid=85897) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 16:11:27 devstack cinder-volume[85897]: DEBUG oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Killing children. {{(pid=85897) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 16:11:27 devstack cinder-volume[85897]: INFO oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Waiting on 1 children to exit Jul 03 16:11:28 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Acquiring lock "singleton_lock" {{(pid=86112) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 16:11:28 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Acquired lock "singleton_lock" {{(pid=86112) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 16:11:28 devstack cinder-volume[86112]: DEBUG oslo_concurrency.lockutils [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Releasing lock "singleton_lock" {{(pid=86112) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 16:11:28 devstack cinder-volume[86112]: WARNING amqp [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 16:11:28 devstack cinder-volume[86112]: WARNING amqp [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 16:11:28 devstack cinder-volume[85897]: INFO oslo_service.backend._eventlet.service [None req-9809ced7-77e5-47cd-92b3-68e33f94650e None None] Child 86112 exited with status 0 Jul 03 16:11:29 devstack cinder-volume[86395]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 16:11:29 devstack cinder-volume[86395]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 16:11:29 devstack cinder-volume[86395]: we strongly recommend against using it for new projects. Jul 03 16:11:29 devstack cinder-volume[86395]: If you are already using Eventlet, we recommend migrating to a different Jul 03 16:11:29 devstack cinder-volume[86395]: framework. For more detail see Jul 03 16:11:29 devstack cinder-volume[86395]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 16:11:29 devstack cinder-volume[86395]: import eventlet # noqa Jul 03 16:11:31 devstack cinder-volume[86395]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 16:11:31 devstack cinder-volume[86395]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 16:11:31 devstack cinder-volume[86395]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 16:11:32 devstack cinder-volume[86395]: INFO dbcounter [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Registered counter for database cinder Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_db.sqlalchemy.engines [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG dbcounter [-] [86395] Writer thread running {{(pid=86395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 16:11:33 devstack cinder-volume[86395]: INFO cinder.rpc [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 16:11:33 devstack cinder-volume[86395]: INFO cinder.rpc [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_db.sqlalchemy.engines [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:11:33 devstack cinder-volume[86395]: INFO cinder.volume.manager [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Determined volume DB was empty at startup. Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG cinder.volume.manager [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86395) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 16:11:33 devstack cinder-volume[86395]: WARNING stevedore.named [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 16:11:33 devstack cinder-volume[86395]: WARNING castellan.key_manager [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 16:11:33 devstack cinder-volume[86395]: WARNING cinder.keymgr.conf_key_mgr [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 16:11:33 devstack cinder-volume[86395]: INFO cinder.volume.manager [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_db.sqlalchemy.engines [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:11:33 devstack cinder-volume[86395]: INFO oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Starting 1 workers Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Started child 86659 {{(pid=86395) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Full set of CONF: {{(pid=86395) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] ******************************************************************************** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] Configuration options gathered from: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] ================================================================================ {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] allow_availability_zone_fallback = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] allow_compression_on_image_upload = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] allowed_direct_url_schemes = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] api_rate_limit = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86659]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] auth_strategy = keystone {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_availability_zone = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_host = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_stats_polling_interval = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backup_api_class = cinder.backup.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backup_name_template = backup-%s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backup_use_same_host = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backup_use_temp_snapshot = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] chap_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] chap_username = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cinder_internal_tenant_project_id = 71e2ef8c215642ab8b827989028e064f {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cinder_internal_tenant_user_id = 9d3b19c63d0d45e79ed7d8fd4313d152 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cluster = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] compression_format = gzip {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] compute_api_class = cinder.compute.nova.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] config_dir = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] config_source = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] control_exchange = openstack {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] debug = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] default_availability_zone = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] default_group_type = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] default_volume_type = QuobyteHD {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] disk_geometry = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] driver_client_cert = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] driver_client_cert_key = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] driver_data_namespace = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] driver_ssl_cert_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] driver_ssl_cert_verify = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] driver_use_ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] enable_new_services = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] enable_unsupported_driver = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] enabled_backends = ['QuobyteHD'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] enforce_multipath_for_image_xfer = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] filter_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_api_insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:33 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_api_servers = ['http://192.168.122.197/image'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_api_ssl_compression = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_ca_certificates_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_catalog_info = image:glance:publicURL {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_num_retries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance_request_timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] goodness_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] graceful_shutdown_timeout = 5 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] group_api_class = cinder.group.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] host = devstack {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_compress_on_upload = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_conversion_address_space_limit = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_conversion_cpu_limit = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_conversion_disable = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_upload_use_cinder_backend = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_upload_use_internal_tenant = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_volume_cache_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_volume_cache_max_count = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86659) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] image_volume_cache_max_size_gb = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] init_host_max_objects_retrieval = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] instance_format = [instance: %(uuid)s] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] iscsi_target_flags = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] iscsi_write_cache = on {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] iser_helper = tgtadm {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] iser_ip_address = 192.168.122.197 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] iser_port = 3260 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] log_color = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] log_config_append = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] log_dir = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] log_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] log_options = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] log_rotate_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] log_rotate_interval_type = days {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] log_rotation_type = none {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] max_age = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] max_logfile_count = 30 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] max_logfile_size_mb = 200 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] max_over_subscription_ratio = 20.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] message_reap_interval = 86400 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] message_ttl = 2592000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] migration_create_volume_timeout_secs = 300 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] monkey_patch = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] monkey_patch_modules = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] my_ip = 192.168.122.197 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] no_snapshot_gb_quota = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] num_iser_scan_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] num_shell_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] num_volume_device_scan_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] nvmeof_conn_info_version = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] nvmet_ns_id = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] nvmet_port_id = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] osapi_max_limit = 1000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] osapi_volume_ext_list = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] osapi_volume_listen_port = 8776 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] osapi_volume_use_ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] osapi_volume_workers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] per_volume_size_limit = -1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] periodic_fuzzy_delay = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] periodic_interval = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] public_endpoint = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] publish_errors = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] quota_backup_gigabytes = 1000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] quota_backups = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] quota_gigabytes = 1000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] quota_groups = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] quota_snapshots = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] quota_volumes = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] rate_limit_burst = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] rate_limit_except_level = CRITICAL {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] rate_limit_interval = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] reinit_driver_count = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] replication_device = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] report_discard_supported = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] report_interval = 120 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] reservation_clean_interval = 86400 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] reservation_expire = 86400 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] reserved_image_namespaces = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] reserved_percentage = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] rpc_response_timeout = 120 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] run_external_periodic_tasks = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] scst_target_driver = iscsi {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] scst_target_iqn_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_down_time = 720 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] shell_completion = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] snapshot_name_template = snapshot-%s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] state_path = /opt/stack/data/cinder {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] storage_availability_zone = nova {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] storage_protocol = iSCSI {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] syslog_log_facility = LOG_USER {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] target_helper = lioadm {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] target_ip_address = 192.168.122.197 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] target_port = 3260 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] target_protocol = iscsi {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] target_secondary_ip_addresses = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] trace_flags = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86659) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 16:11:34 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.quobyte [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 16:11:34 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.quobyte [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] transport_url = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] until_refresh = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] use_chap_auth = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] use_default_quota_class = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] use_journal = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Running cmd (subprocess): mount.quobyte {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] use_json = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] use_multipath_for_image_xfer = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] use_stderr = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] use_syslog = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] verify_glance_signatures = enabled {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_api_class = cinder.volume.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_backend_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_clear = zero {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_clear_ionice = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_clear_size = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_copy_bps_limit = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_dd_blocksize = 1M {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_name_template = volume-%s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_service_inithost_offload = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volume_usage_audit_period = month {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] zoning_mode = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_concurrency.disable_process_locking = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.auth_section = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.auth_type = password {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.auth_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.cache = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.include_service_catalog = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.interface = public {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_password = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcache_username = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.region_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.service_type = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.197/identity {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.backend = dogpile.cache.null {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.backend_argument = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.backend_expiration_time = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.config_prefix = cache.oslo {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.debug_cache_backend = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.enable_retry_client = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.enable_socket_keepalive = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.expiration_time = 600 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.hashclient_retry_attempts = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.memcache_dead_retry = 300 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.memcache_pool_maxsize = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.memcache_sasl_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.proxies = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.redis_db = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.redis_server = localhost:6379 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.retry_attempts = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.retry_delay = 0.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.socket_keepalive_count = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.socket_keepalive_idle = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.socket_keepalive_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.socket_timeout = 1.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.tls_allowed_ciphers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.tls_cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.tls_certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.tls_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.tls_keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cache.username = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] coordination.backend_url = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.asyncio_connection = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.asyncio_slave_connection = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.backend = sqlalchemy {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.connection = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.connection_debug = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.connection_parameters = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.connection_recycle_time = 3600 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.connection_trace = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.db_inc_retry_interval = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.db_max_retries = 20 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.db_max_retry_interval = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.db_retry_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.max_overflow = 50 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.max_pool_size = 5 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.max_retries = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.mysql_wsrep_sync_wait = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.pool_timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.retry_interval = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.slave_connection = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.sqlite_synchronous = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.synchronous_reader = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] database.use_db_reconnect = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.connection_string = messaging:// {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.es_doc_type = notification {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.es_scroll_size = 10000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.es_scroll_time = 2m {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.filter_error_trace = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.hmac_keys = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.sentinel_service_name = mymaster {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.socket_timeout = 0.1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.trace_requests = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler.trace_sqlalchemy = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler_jaeger.process_tags = {} {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler_jaeger.service_name_prefix = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] profiler_otlp.service_name_prefix = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.enforce_new_defaults = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.enforce_scope = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.policy_default_rule = default {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.policy_file = policy.yaml {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] privsep_osbrick.group = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] privsep_osbrick.helper_command = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] privsep_osbrick.user = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cinder_sys_admin.group = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cinder_sys_admin.helper_command = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] cinder_sys_admin.user = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.auth_section = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.auth_type = password {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.collect_timing = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.send_service_user_token = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] service_user.timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.auth_section = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.auth_type = password {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.collect_timing = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.region_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] glance.timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.backend_availability_zone = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.chap_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.chap_username = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.disk_geometry = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.driver_client_cert = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.driver_client_cert_key = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.driver_data_namespace = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.driver_use_ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.extra_capabilities = {} {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.filter_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.goodness_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.iscsi_target_flags = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.iscsi_write_cache = on {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.iser_helper = tgtadm {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.iser_ip_address = 192.168.122.197 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.iser_port = 3260 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_host = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_login = admin {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_mount_options = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_private_key = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_share_path = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.num_shell_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] CMD "mount.quobyte" returned: 1 in 0.166s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.quobyte_volume_url = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.replication_device = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.report_discard_supported = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.reserved_percentage = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.target_helper = tgtadm {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.target_ip_address = 192.168.122.197 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.target_port = 3260 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.target_protocol = iscsi {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.trace_flags = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.unique_fqdn_network = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.use_chap_auth = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.volume_backend_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.volume_clear = zero {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.volume_clear_ionice = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.volume_clear_size = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_reports.file_event_handler = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_reports.log_dir = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.backend_availability_zone = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.backend_host = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.chap_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.chap_username = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.chiscsi_conf = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.disk_geometry = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.driver_client_cert = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.driver_data_namespace = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.driver_use_ssl = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.extra_capabilities = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.filter_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.goodness_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.iser_helper = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.iser_ip_address = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.iser_port = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.iser_target_prefix = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_host = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_login = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_mount_options = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_private_key = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_share_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_ssh_port = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.num_shell_tries = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.nvmet_port_id = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.replication_device = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.report_discard_supported = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.reserved_percentage = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.scst_target_driver = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.storage_protocol = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.target_helper = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.target_ip_address = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.target_port = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.target_prefix = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.target_protocol = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.trace_flags = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.use_chap_auth = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.volume_clear = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.volume_clear_size = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] QuobyteHD.volumes_dir = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_notifications.driver = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_notifications.retry = -1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] key_manager.fixed_key = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.barbican_api_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.barbican_endpoint = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.barbican_endpoint_type = public {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.barbican_region_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.collect_timing = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.number_of_retries = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.retry_delay = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.send_service_user_token = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.verify_ssl = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican.verify_ssl_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican_service_user.auth_section = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican_service_user.auth_type = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican_service_user.cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican_service_user.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican_service_user.collect_timing = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican_service_user.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican_service_user.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican_service_user.split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] barbican_service_user.timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.approle_role_id = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.approle_secret_id = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.kv_mountpoint = secret {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.kv_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.kv_version = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.namespace = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.root_token_id = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.ssl_ca_crt_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.timeout = 60.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.use_ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 16:11:34 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-2e1ac2df-b09d-47ad-b2b3-2dfe55573652 None None] ******************************************************************************** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 16:11:35 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.997s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:35 devstack cinder-volume[86659]: INFO cinder.volume.driver [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Driver hasn't implemented _init_vendor_properties() Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG cinder.volume.driver [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86659) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG oslo_db.sqlalchemy.engines [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writer thread running {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG cinder.db.api [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Building query based on filter {{(pid=86659) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86659) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:11:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:35 devstack cinder-volume[86659]: INFO cinder.keymgr.migration [None req-c641b3d5-ea31-4809-b6d3-9bd004cb1b97 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 16:11:35 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:11:35 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:36 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.636s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:11:36 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Driver initialization completed successfully. Jul 03 16:11:36 devstack cinder-volume[86659]: INFO cinder.manager [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Initiating service 3 cleanup Jul 03 16:11:36 devstack cinder-volume[86659]: INFO cinder.manager [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Service 3 cleanup completed. Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG cinder.service [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Creating RPC server for service cinder-volume {{(pid=86659) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG cinder.service [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86659) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 16:11:36 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:11:36 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:11:36 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:11:36 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Jul 03 16:11:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.652s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:11:36 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1e39bba9-3345-4621-bc4a-4d6932f0b15d None None] Driver post RPC initialization completed successfully. Jul 03 16:11:43 devstack cinder-volume[86395]: DEBUG dbcounter [-] [86395] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:11:46 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=2 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:11:46 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:12:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:12:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 6 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:12:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:12:53 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:12:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Flow 'volume_create_manager' (717a93d2-5303-40a9-9412-11e2be1f28dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:12:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c844251a-ad3b-4e53-b7a7-642d01127e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c844251a-ad3b-4e53-b7a7-642d01127e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1514511145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a32f7b-150e-438d-a2ba-7798e63c366d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97272ce32104e328fafd9b113699471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:12:54Z,use_quota=True,user_id='b6479dcc57c44f0aa99e14950fb89d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fc7c0c-b9dd-49f5-bd38-1905f9cf5bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fc7c0c-b9dd-49f5-bd38-1905f9cf5bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42285ce-e982-49e0-952f-fdef8cf70cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42285ce-e982-49e0-952f-fdef8cf70cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a32f7b-150e-438d-a2ba-7798e63c366d', 'volume_name': 'volume-94a32f7b-150e-438d-a2ba-7798e63c366d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2c01bc-90ff-4061-b2d2-c70efffa222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2c01bc-90ff-4061-b2d2-c70efffa222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efa02b0-0ba9-4b7a-b91d-85a00be43b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:12:54 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Volume 94a32f7b-150e-438d-a2ba-7798e63c366d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a32f7b-150e-438d-a2ba-7798e63c366d', 'volume_size': 1} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1514511145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a32f7b-150e-438d-a2ba-7798e63c366d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97272ce32104e328fafd9b113699471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:12:54Z,use_quota=True,user_id='b6479dcc57c44f0aa99e14950fb89d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Creating volume 94a32f7b-150e-438d-a2ba-7798e63c366d {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:12:54 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:12:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:12:54 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d 1073741824 Jul 03 16:12:54 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:12:55 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Jul 03 16:12:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d 1073741824" returned: 0 in 1.665s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:12:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:12:55 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d Jul 03 16:12:55 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:12:57 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Jul 03 16:12:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d" returned: 0 in 1.147s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:12:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] <== create_volume: return (2914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:12:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.921s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:12:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efa02b0-0ba9-4b7a-b91d-85a00be43b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a32f7b-150e-438d-a2ba-7798e63c366d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:12:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62d39f5-800b-41d3-83b9-d3a0340039f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:12:57 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Volume volume-94a32f7b-150e-438d-a2ba-7798e63c366d (94a32f7b-150e-438d-a2ba-7798e63c366d): created successfully Jul 03 16:12:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62d39f5-800b-41d3-83b9-d3a0340039f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:12:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Flow 'volume_create_manager' (717a93d2-5303-40a9-9412-11e2be1f28dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:12:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-578e1ed2-e0d1-4e4d-b591-32a21b8a928b tempest-DeleteServersTestJSON-1310829068 None] Created volume successfully. Jul 03 16:13:03 devstack cinder-volume[86659]: WARNING py.warnings [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 03 16:13:03 devstack cinder-volume[86659]: .first() Jul 03 16:13:03 devstack cinder-volume[86659]: Jul 03 16:13:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:13:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:13:03 devstack cinder-volume[86659]: INFO oslo.privsep.daemon [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyi7umwkt/privsep.sock'] Jul 03 16:13:03 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyi7umwkt/privsep.sock Jul 03 16:13:03 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:04 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 16:13:04 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 16:13:04 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 16:13:04 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 16:13:04 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 16:13:04 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 16:13:04 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 16:13:04 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 16:13:04 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 16:13:05 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 16:13:05 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 16:13:05 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 16:13:05 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 16:13:05 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 16:13:05 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 16:13:05 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 16:13:05 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 16:13:05 devstack cinder-volume[86659]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 16:13:05 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:05 devstack cinder-volume[86659]: INFO oslo.privsep.daemon [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] Spawned new privsep daemon via rootwrap Jul 03 16:13:05 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] Accepted privsep connection to /tmp/tmpyi7umwkt/privsep.sock {{(pid=86659) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 16:13:05 devstack cinder-volume[86659]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 16:13:05 devstack cinder-volume[86659]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 16:13:05 devstack cinder-volume[86659]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 03 16:13:05 devstack cinder-volume[86659]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87851 Jul 03 16:13:05 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5a91a3-37f4-479e-8143-d05e3f53e0d4]: (2,) {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:13:05 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d0c02b-e95e-4d95-9354-7eb12b10cc88]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:13:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:05 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d Jul 03 16:13:05 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:06 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d" returned: 0 in 0.827s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.550s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:13:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-94a32f7b-150e-438d-a2ba-7798e63c366d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e28d66ca-a397-43be-8df4-1f4630520da3', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:13:06 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-14219503-e292-4626-b72f-9f8a11deb6e1 req-ac75a12e-4e18-4dc5-b0ec-91cf73749bdb tempest-DeleteServersTestJSON-1310829068 None] attachment_update completed successfully. Jul 03 16:13:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-2b66a6be-4bbd-413c-9854-7612b58c4214 req-c0e9df5f-e591-4f9d-beab-ca1e249371d3 tempest-DeleteServersTestJSON-1310829068 None] Terminate volume connection completed successfully. Jul 03 16:13:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2b66a6be-4bbd-413c-9854-7612b58c4214 req-c0e9df5f-e591-4f9d-beab-ca1e249371d3 tempest-DeleteServersTestJSON-1310829068 None] Deleting attachment e28d66ca-a397-43be-8df4-1f4630520da3. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:13:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:13:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:13:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:13:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:13:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:13:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:13:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:18 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:13:18 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Acquiring lock "cinder-94a32f7b-150e-438d-a2ba-7798e63c366d-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Lock "cinder-94a32f7b-150e-438d-a2ba-7798e63c366d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Acquiring lock "cinder-quobyte-94a32f7b-150e-438d-a2ba-7798e63c366d" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Lock "cinder-quobyte-94a32f7b-150e-438d-a2ba-7798e63c366d" acquired by "delete_volume" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:13:20 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.841s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 8 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b8e0cd-a691-4811-a78d-d2707bce151c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:13:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:21 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d Jul 03 16:13:21 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Flow 'volume_create_manager' (3fbd5e62-bc30-47d8-abac-f962961d4eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90dc9ae-022f-4345-b634-6f85bffc0638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90dc9ae-022f-4345-b634-6f85bffc0638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-754047581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a585c0ed0e4e0f995cb1a089cfd6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:13:21Z,use_quota=True,user_id='e14fd8b4e53d4e82a16cc1309cbbd6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae410e2-ed96-4d23-ac7a-fe2ebf463629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae410e2-ed96-4d23-ac7a-fe2ebf463629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9d5436-daa3-48bd-9b90-521ec9a7e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9d5436-daa3-48bd-9b90-521ec9a7e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9', 'volume_name': 'volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b3d4bf-42cf-4328-9c2b-c9a5a4c83a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b3d4bf-42cf-4328-9c2b-c9a5a4c83a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fbcd3a-06b6-4b93-a676-4301dce55ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:21 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Volume bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9', 'volume_size': 1} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-754047581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a585c0ed0e4e0f995cb1a089cfd6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:13:21Z,use_quota=True,user_id='e14fd8b4e53d4e82a16cc1309cbbd6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Creating volume bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:13:21 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:13:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:21 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 1073741824 Jul 03 16:13:21 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:23 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d" returned: 0 in 2.213s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:23 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d Jul 03 16:13:23 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:23 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 1073741824" returned: 0 in 2.083s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:23 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 Jul 03 16:13:23 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:24 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-94a32f7b-150e-438d-a2ba-7798e63c366d" returned: 0 in 1.980s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Lock "cinder-quobyte-94a32f7b-150e-438d-a2ba-7798e63c366d" released by "delete_volume" :: held 4.299s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:13:25 devstack cinder-volume[86659]: WARNING cinder.quota [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:13:25 devstack cinder-volume[86659]: WARNING cinder.quota [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:13:25 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Created reservations ['e0bb29e6-b0cb-4309-8b11-d879db696f4d', '53a9e613-77d2-4c90-b5fa-15345517bf87', '9aaee79d-4594-41ef-9029-ddffa5d89aaf', '75fad689-85a7-4ca8-af59-0b46b653a894'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:13:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:13:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:13:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:13:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:13:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:13:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:25 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:13:25 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:26 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9" returned: 0 in 2.445s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] <== create_volume: return (4626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:13:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.631s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:13:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fbcd3a-06b6-4b93-a676-4301dce55ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc52a51-597e-4f83-9562-b8558cb7eb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Volume volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 (bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9): created successfully Jul 03 16:13:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc52a51-597e-4f83-9562-b8558cb7eb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Flow 'volume_create_manager' (3fbd5e62-bc30-47d8-abac-f962961d4eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:13:26 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-48dad760-01da-4986-ba7e-41b4b293bfff tempest-VolumesAdminNegativeTest-556941892 None] Created volume successfully. Jul 03 16:13:27 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.676s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:27 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:13:27 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Deleted volume successfully. Jul 03 16:13:27 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a482911b-0ca8-4328-998c-85e3c2413717 tempest-DeleteServersTestJSON-1310829068 None] Lock "cinder-94a32f7b-150e-438d-a2ba-7798e63c366d-delete_volume" released by "delete_volume" :: held 6.624s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:13:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Acquiring lock "cinder-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:13:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Lock "cinder-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:13:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Acquiring lock "cinder-quobyte-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:13:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Lock "cinder-quobyte-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:13:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a30f11-889c-428a-80de-86a600c6bc1d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:13:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:29 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 Jul 03 16:13:29 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:30 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9" returned: 0 in 1.294s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:30 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9 Jul 03 16:13:30 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:31 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9" returned: 0 in 1.211s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Lock "cinder-quobyte-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9" released by "delete_volume" :: held 2.594s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:13:31 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Created reservations ['a2326a45-cda3-463a-ace8-16185c43285a', 'c1a8385f-a449-4816-b017-fda98fd5388f', '59d4f841-78d3-4c41-8642-e3bd359620d2', 'cf163b3f-4b3b-4c87-9d08-1e487856eff9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:13:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:13:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:13:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:13:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:13:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:13:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:31 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:13:31 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:32 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.285s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:32 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:13:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Deleted volume successfully. Jul 03 16:13:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-72e8e009-035b-47e7-9849-17fe356e0e87 tempest-VolumesAdminNegativeTest-556941892 None] Lock "cinder-bea1e4f7-71ae-4d6d-837c-eee0fcdc2cd9-delete_volume" released by "delete_volume" :: held 4.250s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=23,cinder:SELECT=19,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Flow 'volume_create_manager' (7269178c-0a0b-4b9b-86ab-09c18a479849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6f9325-5f8e-4472-8df7-3b0c371cd5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6f9325-5f8e-4472-8df7-3b0c371cd5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1141837950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11365b83-0897-4476-9af6-9f0d2e57f5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3249dbf2394a518e53a28a0d6012ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:13:46Z,use_quota=True,user_id='d2767c7763224d4fa97064cfdd89c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c930a18c-5df5-4de5-ae5a-be510cb90dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c930a18c-5df5-4de5-ae5a-be510cb90dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14260ced-dfd5-45d1-871e-2f306b7b6755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14260ced-dfd5-45d1-871e-2f306b7b6755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11365b83-0897-4476-9af6-9f0d2e57f5c7', 'volume_name': 'volume-11365b83-0897-4476-9af6-9f0d2e57f5c7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2ce247-868b-4120-a6f0-d15879587857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2ce247-868b-4120-a6f0-d15879587857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8508c0a-cf44-426f-94a1-2186c2fae557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:46 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Volume 11365b83-0897-4476-9af6-9f0d2e57f5c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11365b83-0897-4476-9af6-9f0d2e57f5c7', 'volume_size': 1} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1141837950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11365b83-0897-4476-9af6-9f0d2e57f5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3249dbf2394a518e53a28a0d6012ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:13:46Z,use_quota=True,user_id='d2767c7763224d4fa97064cfdd89c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Creating volume 11365b83-0897-4476-9af6-9f0d2e57f5c7 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:13:46 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:13:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:46 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 1073741824 Jul 03 16:13:46 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:47 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 1073741824" returned: 0 in 1.020s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:47 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=26,cinder:INSERT=4,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:13:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:47 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 Jul 03 16:13:47 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:48 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7" returned: 0 in 0.750s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:13:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:13:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8508c0a-cf44-426f-94a1-2186c2fae557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11365b83-0897-4476-9af6-9f0d2e57f5c7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36013a0-e886-40e4-a3bd-a9ba807086cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:13:48 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Volume volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 (11365b83-0897-4476-9af6-9f0d2e57f5c7): created successfully Jul 03 16:13:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36013a0-e886-40e4-a3bd-a9ba807086cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:13:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Flow 'volume_create_manager' (7269178c-0a0b-4b9b-86ab-09c18a479849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:13:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-02a1419c-7464-43f7-a93f-5f2bd8e4405b tempest-AttachVolumeTestJSON-1070374690 None] Created volume successfully. Jul 03 16:13:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-c4be0378-e5f5-4c3b-8941-379567889991 req-74b30a84-ed98-44ac-bfc1-5b276dc61876 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:13:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-c4be0378-e5f5-4c3b-8941-379567889991 req-74b30a84-ed98-44ac-bfc1-5b276dc61876 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:13:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a80a7a-527b-4974-94f3-5372bafd946d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:13:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c4be0378-e5f5-4c3b-8941-379567889991 req-74b30a84-ed98-44ac-bfc1-5b276dc61876 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:13:52 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 Jul 03 16:13:52 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:13:53 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Jul 03 16:13:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c4be0378-e5f5-4c3b-8941-379567889991 req-74b30a84-ed98-44ac-bfc1-5b276dc61876 tempest-AttachVolumeTestJSON-1070374690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7" returned: 0 in 0.929s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:13:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-c4be0378-e5f5-4c3b-8941-379567889991 req-74b30a84-ed98-44ac-bfc1-5b276dc61876 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.954s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:13:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-c4be0378-e5f5-4c3b-8941-379567889991 req-74b30a84-ed98-44ac-bfc1-5b276dc61876 tempest-AttachVolumeTestJSON-1070374690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-11365b83-0897-4476-9af6-9f0d2e57f5c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d3f76ac-5ee9-44f9-9497-ce4ad1a08300', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:13:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-c4be0378-e5f5-4c3b-8941-379567889991 req-74b30a84-ed98-44ac-bfc1-5b276dc61876 tempest-AttachVolumeTestJSON-1070374690 None] attachment_update completed successfully. Jul 03 16:14:03 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1,cinder:SELECT=6 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:14:03 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6,cinder:INSERT=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Flow 'volume_create_manager' (b597dc20-4c12-491b-9a48-6bda2824392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87faec6-38ee-4789-8bf9-c94ec6dce76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87faec6-38ee-4789-8bf9-c94ec6dce76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-756185270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e104bf81-bf93-4ded-ac7d-23118355ab05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f7739d12664179a5baaac905085255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:14:19Z,use_quota=True,user_id='1041e52bf44b4f9c955a5afcda38d04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccca35f-d39b-4838-b1a3-48f1c454727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccca35f-d39b-4838-b1a3-48f1c454727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2704d0c8-b2ea-4d4f-b433-23a68d1fe383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2704d0c8-b2ea-4d4f-b433-23a68d1fe383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e104bf81-bf93-4ded-ac7d-23118355ab05', 'volume_name': 'volume-e104bf81-bf93-4ded-ac7d-23118355ab05', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ac91ce-45f2-4251-a474-1e42393100a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ac91ce-45f2-4251-a474-1e42393100a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:19 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:14:19 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fc835d-79a5-4c84-85eb-0e9fdd6fc74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:19 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Volume e104bf81-bf93-4ded-ac7d-23118355ab05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e104bf81-bf93-4ded-ac7d-23118355ab05', 'volume_size': 1} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-756185270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e104bf81-bf93-4ded-ac7d-23118355ab05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f7739d12664179a5baaac905085255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:14:19Z,use_quota=True,user_id='1041e52bf44b4f9c955a5afcda38d04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Creating volume e104bf81-bf93-4ded-ac7d-23118355ab05 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:14:19 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:14:19 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 1073741824 Jul 03 16:14:19 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:14:19 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.860s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:14:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:14:20 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Jul 03 16:14:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 1073741824" returned: 0 in 0.992s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:14:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:14:20 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 Jul 03 16:14:20 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:14:20 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Jul 03 16:14:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05" returned: 0 in 0.690s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:14:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:14:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:14:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fc835d-79a5-4c84-85eb-0e9fdd6fc74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e104bf81-bf93-4ded-ac7d-23118355ab05', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d547863-ee7e-4701-bbc8-161143cd0c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:20 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Volume volume-e104bf81-bf93-4ded-ac7d-23118355ab05 (e104bf81-bf93-4ded-ac7d-23118355ab05): created successfully Jul 03 16:14:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d547863-ee7e-4701-bbc8-161143cd0c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Flow 'volume_create_manager' (b597dc20-4c12-491b-9a48-6bda2824392f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:14:20 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6408bf88-b7cb-40fa-b394-a2faa019c49b tempest-TaggedAttachmentsTest-1849528113 None] Created volume successfully. Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Flow 'volume_create_manager' (43d575a4-4dfc-401a-bf0c-d403b3966b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0fe3b6-2675-4100-8540-f144f1954718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0fe3b6-2675-4100-8540-f144f1954718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1251876820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0c1537-8f57-4c81-8b59-6590d7470a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb861b9dad43c7a1cc581d104989dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:14:24Z,use_quota=True,user_id='07797e1cd7fa4570865a18977ce72945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073a5ad5-c93d-47e6-95b1-177b4e0a8b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073a5ad5-c93d-47e6-95b1-177b4e0a8b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf4346f-6b4b-42c8-ab3a-5236b3ada697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf4346f-6b4b-42c8-ab3a-5236b3ada697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f0c1537-8f57-4c81-8b59-6590d7470a58', 'volume_name': 'volume-6f0c1537-8f57-4c81-8b59-6590d7470a58', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c625e72-46ec-4ad9-96de-09bda7c1f772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c625e72-46ec-4ad9-96de-09bda7c1f772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf3d99e-7800-4b89-9645-ace24ffcf1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:23 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Volume 6f0c1537-8f57-4c81-8b59-6590d7470a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f0c1537-8f57-4c81-8b59-6590d7470a58', 'volume_size': 1} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1251876820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0c1537-8f57-4c81-8b59-6590d7470a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb861b9dad43c7a1cc581d104989dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:14:24Z,use_quota=True,user_id='07797e1cd7fa4570865a18977ce72945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Creating volume 6f0c1537-8f57-4c81-8b59-6590d7470a58 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:14:23 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:14:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:14:23 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 1073741824 Jul 03 16:14:23 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:14:25 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Jul 03 16:14:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 1073741824" returned: 0 in 1.439s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:14:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:14:25 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 Jul 03 16:14:25 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:14:26 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Jul 03 16:14:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58" returned: 0 in 1.117s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:14:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] <== create_volume: return (2654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:14:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.657s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:14:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf3d99e-7800-4b89-9645-ace24ffcf1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0c1537-8f57-4c81-8b59-6590d7470a58', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d573a5-06aa-492f-8dde-896e9712da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:14:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Volume volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 (6f0c1537-8f57-4c81-8b59-6590d7470a58): created successfully Jul 03 16:14:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d573a5-06aa-492f-8dde-896e9712da84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:14:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Flow 'volume_create_manager' (43d575a4-4dfc-401a-bf0c-d403b3966b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:14:26 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7cf6bfe7-3f13-46db-a07a-61764c74f2b3 tempest-ServerActionsTestOtherA-816298766 None] Created volume successfully. Jul 03 16:14:36 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:14:36 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:14:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-083320ed-e481-48ac-979e-271ba4ad6f7d req-4dc323ff-8269-476a-85c1-08f05e03969a tempest-AttachVolumeTestJSON-1070374690 None] Terminate volume connection completed successfully. Jul 03 16:14:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-083320ed-e481-48ac-979e-271ba4ad6f7d req-4dc323ff-8269-476a-85c1-08f05e03969a tempest-AttachVolumeTestJSON-1070374690 None] Deleting attachment 1d3f76ac-5ee9-44f9-9497-ce4ad1a08300. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:15:01 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=2 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Flow 'volume_create_manager' (1bb3099c-04f6-4718-9158-667cf76ef81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4b8dc2-c586-4163-86ad-eb38f4442800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4b8dc2-c586-4163-86ad-eb38f4442800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-791227395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29692ba-3952-473b-9e2c-355c5ec04be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f14332c7ba54eb2946c01ea764fb046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:15:14Z,use_quota=True,user_id='113b57ab620f4a94aaa442a564624c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12d12d3-66b9-42c5-a2a6-caa54c81ec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12d12d3-66b9-42c5-a2a6-caa54c81ec36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c75d21-a7d1-4701-9a0b-d3b846c65ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c75d21-a7d1-4701-9a0b-d3b846c65ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29692ba-3952-473b-9e2c-355c5ec04be7', 'volume_name': 'volume-c29692ba-3952-473b-9e2c-355c5ec04be7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c0620a-d66d-408b-990d-aa5ec9709bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c0620a-d66d-408b-990d-aa5ec9709bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a935ef-bd5d-479f-97c8-54dfac865d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:13 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Volume c29692ba-3952-473b-9e2c-355c5ec04be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29692ba-3952-473b-9e2c-355c5ec04be7', 'volume_size': 1} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-791227395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29692ba-3952-473b-9e2c-355c5ec04be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f14332c7ba54eb2946c01ea764fb046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:15:14Z,use_quota=True,user_id='113b57ab620f4a94aaa442a564624c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Creating volume c29692ba-3952-473b-9e2c-355c5ec04be7 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:15:13 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:15:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:13 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7 1073741824 Jul 03 16:15:13 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:14 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7 1073741824" returned: 0 in 1.106s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:15 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7 Jul 03 16:15:15 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:15 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7" returned: 0 in 0.714s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:15:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a935ef-bd5d-479f-97c8-54dfac865d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29692ba-3952-473b-9e2c-355c5ec04be7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04681364-70e5-44fb-aab1-29598c3c8cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:15 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Volume volume-c29692ba-3952-473b-9e2c-355c5ec04be7 (c29692ba-3952-473b-9e2c-355c5ec04be7): created successfully Jul 03 16:15:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04681364-70e5-44fb-aab1-29598c3c8cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Flow 'volume_create_manager' (1bb3099c-04f6-4718-9158-667cf76ef81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:15:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-47ae975a-54df-47f1-ad0d-380bba31fc4f tempest-ServersNegativeTestJSON-1678090766 None] Created volume successfully. Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Flow 'volume_create_manager' (01a87cac-0e8c-4649-944c-b6f336bdc0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c613d8f3-2544-4a0b-8221-c2c2597ffe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c613d8f3-2544-4a0b-8221-c2c2597ffe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-184650763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8850440e-5f8f-4a0b-bb49-1d09148f18e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f14332c7ba54eb2946c01ea764fb046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:15:18Z,use_quota=True,user_id='113b57ab620f4a94aaa442a564624c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b165c6d-a873-45b6-ae46-03a26248380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b165c6d-a873-45b6-ae46-03a26248380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb087ed2-40f3-4028-85fb-b0b8fee3ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb087ed2-40f3-4028-85fb-b0b8fee3ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8850440e-5f8f-4a0b-bb49-1d09148f18e7', 'volume_name': 'volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335c0c30-5c41-4e75-aa9d-7f8dae6f11d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335c0c30-5c41-4e75-aa9d-7f8dae6f11d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26445132-34b1-4b68-b606-0e1c3c3d258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Volume 8850440e-5f8f-4a0b-bb49-1d09148f18e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7', 'volume_size': 1} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-184650763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8850440e-5f8f-4a0b-bb49-1d09148f18e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f14332c7ba54eb2946c01ea764fb046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:15:18Z,use_quota=True,user_id='113b57ab620f4a94aaa442a564624c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Creating volume 8850440e-5f8f-4a0b-bb49-1d09148f18e7 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:15:18 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:18 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 1073741824 Jul 03 16:15:18 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:18 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:15:18 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:19 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 1073741824" returned: 0 in 0.900s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:19 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 Jul 03 16:15:19 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:19 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.801s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:15:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:15:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 8 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:15:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:15:20 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7" returned: 0 in 0.671s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:15:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26445132-34b1-4b68-b606-0e1c3c3d258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546032cf-ed00-4c03-b23a-ef063c69e385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:20 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Volume volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 (8850440e-5f8f-4a0b-bb49-1d09148f18e7): created successfully Jul 03 16:15:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546032cf-ed00-4c03-b23a-ef063c69e385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Flow 'volume_create_manager' (01a87cac-0e8c-4649-944c-b6f336bdc0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:15:20 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d99ff0d8-17a7-4fd2-8325-a81c67b7f267 tempest-ServersNegativeTestJSON-1678090766 None] Created volume successfully. Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-454b3041-63d9-46d5-9a44-33d60198ed82 req-fbd44577-f445-43a8-a78c-8ccade7b60be tempest-ServerActionsTestOtherA-816298766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-454b3041-63d9-46d5-9a44-33d60198ed82 req-fbd44577-f445-43a8-a78c-8ccade7b60be tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[666a75b1-4949-44de-b779-cc0646a25ec4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-454b3041-63d9-46d5-9a44-33d60198ed82 req-fbd44577-f445-43a8-a78c-8ccade7b60be tempest-ServerActionsTestOtherA-816298766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "cinder-8850440e-5f8f-4a0b-bb49-1d09148f18e7-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:15:22 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 Jul 03 16:15:22 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Lock "cinder-8850440e-5f8f-4a0b-bb49-1d09148f18e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "cinder-quobyte-8850440e-5f8f-4a0b-bb49-1d09148f18e7" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Lock "cinder-quobyte-8850440e-5f8f-4a0b-bb49-1d09148f18e7" acquired by "delete_volume" :: waited 0.014s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f4cf1d-0b47-439a-a73b-2052a98c0de4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:22 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 Jul 03 16:15:22 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:22 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-454b3041-63d9-46d5-9a44-33d60198ed82 req-fbd44577-f445-43a8-a78c-8ccade7b60be tempest-ServerActionsTestOtherA-816298766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58" returned: 0 in 0.861s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-454b3041-63d9-46d5-9a44-33d60198ed82 req-fbd44577-f445-43a8-a78c-8ccade7b60be tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.882s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:23 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7" returned: 0 in 0.814s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:23 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7 Jul 03 16:15:23 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:24 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8850440e-5f8f-4a0b-bb49-1d09148f18e7" returned: 0 in 0.640s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Lock "cinder-quobyte-8850440e-5f8f-4a0b-bb49-1d09148f18e7" released by "delete_volume" :: held 1.497s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:15:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-454b3041-63d9-46d5-9a44-33d60198ed82 req-fbd44577-f445-43a8-a78c-8ccade7b60be tempest-ServerActionsTestOtherA-816298766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-6f0c1537-8f57-4c81-8b59-6590d7470a58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f1ebac5-9e5f-4566-acaa-9461afcf6de6', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:15:25 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Created reservations ['fa48c2c0-26bd-49a7-b02b-1dc83aef7203', 'c5dc03bb-ad25-4856-92a8-75cfeb2f0a2d', 'a45aeaf2-4e97-499a-97d1-170c1f734e09', '6f68f324-aee3-464f-aab0-61f306052557'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:15:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-454b3041-63d9-46d5-9a44-33d60198ed82 req-fbd44577-f445-43a8-a78c-8ccade7b60be tempest-ServerActionsTestOtherA-816298766 None] attachment_update completed successfully. Jul 03 16:15:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:15:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:15:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:25 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:15:25 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "cinder-c29692ba-3952-473b-9e2c-355c5ec04be7-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:15:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Lock "cinder-c29692ba-3952-473b-9e2c-355c5ec04be7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:15:26 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.746s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:26 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:15:26 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Deleted volume successfully. Jul 03 16:15:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "cinder-quobyte-c29692ba-3952-473b-9e2c-355c5ec04be7" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:15:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9547fc90-d35e-446c-9f37-5363be375fd5 tempest-ServersNegativeTestJSON-1678090766 None] Lock "cinder-8850440e-5f8f-4a0b-bb49-1d09148f18e7-delete_volume" released by "delete_volume" :: held 4.441s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:15:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Lock "cinder-quobyte-c29692ba-3952-473b-9e2c-355c5ec04be7" acquired by "delete_volume" :: waited 0.030s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:15:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7addc34d-1eec-411e-aeff-7d9a263fabad]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:15:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:26 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7 Jul 03 16:15:26 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:27 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7" returned: 0 in 0.823s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:27 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7 Jul 03 16:15:27 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:28 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c29692ba-3952-473b-9e2c-355c5ec04be7" returned: 0 in 0.730s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Lock "cinder-quobyte-c29692ba-3952-473b-9e2c-355c5ec04be7" released by "delete_volume" :: held 1.598s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:15:28 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Created reservations ['5a58ec9c-179a-4966-b1db-1f903d32a698', '78b81a7b-eb21-40d7-a39c-cbcdbb11ef2c', '04e9ba90-30bf-44d9-851b-4d588e77a229', 'fbbf36ac-dabe-4d73-8687-d385329fe5d9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:15:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:15:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:15:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:28 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:15:28 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:29 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.738s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:29 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:15:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Deleted volume successfully. Jul 03 16:15:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a18337bf-bbda-447d-8fbf-a2a544359009 tempest-ServersNegativeTestJSON-1678090766 None] Lock "cinder-c29692ba-3952-473b-9e2c-355c5ec04be7-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:15:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-6a8a3e75-22b2-4ec7-b30e-1ae226df5326 req-148b6aa4-311d-4f4e-a44c-ad005448cad6 tempest-ServerActionsTestOtherA-816298766 None] Terminate volume connection completed successfully. Jul 03 16:15:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-6a8a3e75-22b2-4ec7-b30e-1ae226df5326 req-148b6aa4-311d-4f4e-a44c-ad005448cad6 tempest-ServerActionsTestOtherA-816298766 None] Deleting attachment 5f1ebac5-9e5f-4566-acaa-9461afcf6de6. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:15:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-6a8a3e75-22b2-4ec7-b30e-1ae226df5326 req-275270bf-08b1-40f4-a8cc-9b065a825890 tempest-ServerActionsTestOtherA-816298766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-6a8a3e75-22b2-4ec7-b30e-1ae226df5326 req-275270bf-08b1-40f4-a8cc-9b065a825890 tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:37 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0addb9-519b-49a9-a550-5f154e75a363]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:15:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-6a8a3e75-22b2-4ec7-b30e-1ae226df5326 req-275270bf-08b1-40f4-a8cc-9b065a825890 tempest-ServerActionsTestOtherA-816298766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:37 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 Jul 03 16:15:37 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:38 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-6a8a3e75-22b2-4ec7-b30e-1ae226df5326 req-275270bf-08b1-40f4-a8cc-9b065a825890 tempest-ServerActionsTestOtherA-816298766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58" returned: 0 in 0.937s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-6a8a3e75-22b2-4ec7-b30e-1ae226df5326 req-275270bf-08b1-40f4-a8cc-9b065a825890 tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.972s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-6a8a3e75-22b2-4ec7-b30e-1ae226df5326 req-275270bf-08b1-40f4-a8cc-9b065a825890 tempest-ServerActionsTestOtherA-816298766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-6f0c1537-8f57-4c81-8b59-6590d7470a58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82aaff18-3fb4-45fe-8b96-dce21c07eb5d', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:15:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-6a8a3e75-22b2-4ec7-b30e-1ae226df5326 req-275270bf-08b1-40f4-a8cc-9b065a825890 tempest-ServerActionsTestOtherA-816298766 None] attachment_update completed successfully. Jul 03 16:15:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-ebe217f5-4843-423a-b02a-bd88912ec2b6 req-efb4cc05-9d42-4c2a-8de5-b30222894dca tempest-TaggedAttachmentsTest-1849528113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-ebe217f5-4843-423a-b02a-bd88912ec2b6 req-efb4cc05-9d42-4c2a-8de5-b30222894dca tempest-TaggedAttachmentsTest-1849528113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:43 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7b65e9-cc06-4ec1-a1b3-3b23aa1a25b1]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:15:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-ebe217f5-4843-423a-b02a-bd88912ec2b6 req-efb4cc05-9d42-4c2a-8de5-b30222894dca tempest-TaggedAttachmentsTest-1849528113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:43 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 Jul 03 16:15:43 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:44 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-ebe217f5-4843-423a-b02a-bd88912ec2b6 req-efb4cc05-9d42-4c2a-8de5-b30222894dca tempest-TaggedAttachmentsTest-1849528113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05" returned: 0 in 0.895s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-ebe217f5-4843-423a-b02a-bd88912ec2b6 req-efb4cc05-9d42-4c2a-8de5-b30222894dca tempest-TaggedAttachmentsTest-1849528113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-ebe217f5-4843-423a-b02a-bd88912ec2b6 req-efb4cc05-9d42-4c2a-8de5-b30222894dca tempest-TaggedAttachmentsTest-1849528113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-e104bf81-bf93-4ded-ac7d-23118355ab05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7b0b09b-2bc7-451f-8187-8392b496a4d3', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:15:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-ebe217f5-4843-423a-b02a-bd88912ec2b6 req-efb4cc05-9d42-4c2a-8de5-b30222894dca tempest-TaggedAttachmentsTest-1849528113 None] attachment_update completed successfully. Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Flow 'volume_create_manager' (e9e62d26-5a3c-41a8-803e-8b71f723d7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b7b476-c40c-4e29-8bf9-9d7e2e78152c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b7b476-c40c-4e29-8bf9-9d7e2e78152c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1670596289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1a1108-ddee-493d-856b-312254716db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c077c4b45dfa434fbab083367e1a4cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:15:46Z,use_quota=True,user_id='3dc31ec252644ec3807f464a68c9bccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bef55ec-7dd0-4aff-9480-0b5157f0917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bef55ec-7dd0-4aff-9480-0b5157f0917e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1fa3c7-0305-4768-b896-5735fa18b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1fa3c7-0305-4768-b896-5735fa18b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1a1108-ddee-493d-856b-312254716db9', 'volume_name': 'volume-0b1a1108-ddee-493d-856b-312254716db9', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a922e984-0376-4da8-bc3b-272a94b5ed83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a922e984-0376-4da8-bc3b-272a94b5ed83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54f3ad9-470b-4608-bcf8-c97adb120f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:46 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Volume 0b1a1108-ddee-493d-856b-312254716db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1a1108-ddee-493d-856b-312254716db9', 'volume_size': 1} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1670596289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1a1108-ddee-493d-856b-312254716db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c077c4b45dfa434fbab083367e1a4cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:15:46Z,use_quota=True,user_id='3dc31ec252644ec3807f464a68c9bccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Creating volume 0b1a1108-ddee-493d-856b-312254716db9 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:15:46 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:15:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:46 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 1073741824 Jul 03 16:15:46 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:47 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 1073741824" returned: 0 in 1.128s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:47 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 Jul 03 16:15:47 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:48 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9" returned: 0 in 0.806s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54f3ad9-470b-4608-bcf8-c97adb120f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1a1108-ddee-493d-856b-312254716db9', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec43d6c-245f-4596-85d3-364441f2da9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:15:48 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Volume volume-0b1a1108-ddee-493d-856b-312254716db9 (0b1a1108-ddee-493d-856b-312254716db9): created successfully Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec43d6c-245f-4596-85d3-364441f2da9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Flow 'volume_create_manager' (e9e62d26-5a3c-41a8-803e-8b71f723d7ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:15:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-2435d327-de0e-4402-afa4-aed8bdab7cd6 req-ac511daf-f77f-4318-af2e-c3989aabd791 tempest-VolumesSnapshotsTestJSON-992989317 None] Created volume successfully. Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Creating offline snapshot 44cef64c-821c-4c73-af51-8350d1398fdc of volume 0b1a1108-ddee-493d-856b-312254716db9 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bed0b2e-d1af-40b8-be64-7982787e2455]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:15:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:48 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 Jul 03 16:15:48 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:49 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9" returned: 0 in 0.830s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:49 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc 1G Jul 03 16:15:49 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:50 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc 1G" returned: 0 in 0.876s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1a1108-ddee-493d-856b-312254716db9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:50 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1a1108-ddee-493d-856b-312254716db9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc Jul 03 16:15:50 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:51 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1a1108-ddee-493d-856b-312254716db9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc" returned: 0 in 0.713s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:51 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc is being set with open permissions: ugo+rw Jul 03 16:15:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:51 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc Jul 03 16:15:51 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-a8b62254-4231-4efe-85d0-1aa32f284d7d req-528cc386-f723-48a5-93e8-985bc348ea20 tempest-TaggedAttachmentsTest-1849528113 None] Terminate volume connection completed successfully. Jul 03 16:15:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-a8b62254-4231-4efe-85d0-1aa32f284d7d req-528cc386-f723-48a5-93e8-985bc348ea20 tempest-TaggedAttachmentsTest-1849528113 None] Deleting attachment b7b0b09b-2bc7-451f-8187-8392b496a4d3. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:15:52 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc" returned: 0 in 0.926s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:52 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.info Jul 03 16:15:52 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:53 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.info" returned: 0 in 1.229s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:53 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.info is being set with open permissions: ugo+rw Jul 03 16:15:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:53 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.info Jul 03 16:15:53 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:54 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.info" returned: 0 in 0.875s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.609s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:15:54 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-c3a8d07c-812d-47d4-926a-7af44b680b17 req-398e6255-9316-4e49-aadb-ed46c718f1e0 tempest-VolumesSnapshotsTestJSON-992989317 None] Create snapshot completed successfully Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Acquiring lock "cinder-44cef64c-821c-4c73-af51-8350d1398fdc-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-44cef64c-821c-4c73-af51-8350d1398fdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Acquiring lock "cinder-quobyte-0b1a1108-ddee-493d-856b-312254716db9" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-quobyte-0b1a1108-ddee-493d-856b-312254716db9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Acquiring lock "cinder-quobyte-44cef64c-821c-4c73-af51-8350d1398fdc" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-quobyte-44cef64c-821c-4c73-af51-8350d1398fdc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Deleting offline snapshot 44cef64c-821c-4c73-af51-8350d1398fdc of volume 0b1a1108-ddee-493d-856b-312254716db9 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] snapshot_file for this snap is: volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf108ae6-c3d7-4797-90fb-cd50074e2fb6]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:15:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:55 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc Jul 03 16:15:55 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:56 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc" returned: 0 in 0.857s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b1a1108-ddee-493d-856b-312254716db9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:15:56 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c34697-539f-4805-a741-f40fecc5fad2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:15:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:56 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 Jul 03 16:15:56 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:57 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9" returned: 0 in 0.990s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:57 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc Jul 03 16:15:57 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:58 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc" returned: 0 in 0.883s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:15:58 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc Jul 03 16:15:58 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:15:59 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Jul 03 16:15:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9.44cef64c-821c-4c73-af51-8350d1398fdc" returned: 0 in 0.794s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:15:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-quobyte-44cef64c-821c-4c73-af51-8350d1398fdc" released by "_delete_snapshot" :: held 3.643s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:15:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-quobyte-0b1a1108-ddee-493d-856b-312254716db9" released by "delete_snapshot" :: held 3.671s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:15:59 devstack cinder-volume[86659]: WARNING cinder.quota [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:15:59 devstack cinder-volume[86659]: DEBUG cinder.quota [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Created reservations ['643e448b-7237-4e04-82e5-78251540cba4', '35ec567d-c779-47ab-ba9c-0ba248c8d8b8', '63eb812b-f189-4b25-8db8-c01503a2efd0', '7411ae83-8a9e-4115-bd71-d96c5134554c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:15:59 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Delete snapshot completed successfully. Jul 03 16:15:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3a2a1478-8b99-4327-9c98-8d7c074decce req-1cdb3d6f-7a5b-43a2-b405-fc3ab8487af2 tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-44cef64c-821c-4c73-af51-8350d1398fdc-delete_snapshot" released by "delete_snapshot" :: held 3.820s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Acquiring lock "cinder-0b1a1108-ddee-493d-856b-312254716db9-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-0b1a1108-ddee-493d-856b-312254716db9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Acquiring lock "cinder-quobyte-0b1a1108-ddee-493d-856b-312254716db9" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-quobyte-0b1a1108-ddee-493d-856b-312254716db9" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[09604660-4a8a-4dbe-8716-42683fe5697e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:00 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 Jul 03 16:16:00 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:01 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9" returned: 0 in 1.113s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:01 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9 Jul 03 16:16:01 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:02 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0b1a1108-ddee-493d-856b-312254716db9" returned: 0 in 1.117s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-quobyte-0b1a1108-ddee-493d-856b-312254716db9" released by "delete_volume" :: held 2.360s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:02 devstack cinder-volume[86659]: DEBUG cinder.quota [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Created reservations ['31f34e2e-efd7-4c48-bf66-b52b7140c839', 'f4912e16-60b4-4fcc-940f-41f00fced4d9', 'bc0165ca-5067-44ce-8550-4b4d5a36d674', '7b5ccbc2-5da6-4afc-8c66-c0e90bc2b91a'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:16:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:02 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:16:02 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:03 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.722s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:03 devstack cinder-volume[86659]: DEBUG cinder.manager [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:16:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Deleted volume successfully. Jul 03 16:16:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-528d1386-88de-472f-9c5c-949e1c10078a req-ff0420f5-228a-4704-9f5c-bfd053265d8e tempest-VolumesSnapshotsTestJSON-992989317 None] Lock "cinder-0b1a1108-ddee-493d-856b-312254716db9-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Acquiring lock "cinder-e104bf81-bf93-4ded-ac7d-23118355ab05-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Lock "cinder-e104bf81-bf93-4ded-ac7d-23118355ab05-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:10 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=48,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:16:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Acquiring lock "cinder-quobyte-e104bf81-bf93-4ded-ac7d-23118355ab05" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Lock "cinder-quobyte-e104bf81-bf93-4ded-ac7d-23118355ab05" acquired by "delete_volume" :: waited 0.049s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:11 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fbede9-d4d3-422d-975d-ac96bf0e3651]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:11 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 Jul 03 16:16:11 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:12 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05" returned: 0 in 1.025s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:12 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05 Jul 03 16:16:12 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:13 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e104bf81-bf93-4ded-ac7d-23118355ab05" returned: 0 in 0.862s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Lock "cinder-quobyte-e104bf81-bf93-4ded-ac7d-23118355ab05" released by "delete_volume" :: held 2.002s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=44,cinder:SELECT=53,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:16:13 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-63833099-4e31-4e13-b2d9-940fb9f415e5 req-e1cc74dd-556d-4cd8-aca3-cf4c9659323c tempest-ServerActionsTestOtherA-816298766 None] Terminate volume connection completed successfully. Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-63833099-4e31-4e13-b2d9-940fb9f415e5 req-e1cc74dd-556d-4cd8-aca3-cf4c9659323c tempest-ServerActionsTestOtherA-816298766 None] Deleting attachment 82aaff18-3fb4-45fe-8b96-dce21c07eb5d. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Created reservations ['2e7f7c5b-8c29-487c-9631-ce38441387ed', 'a2d5dd11-a177-40d6-95ba-097cadb55b62', 'ae6550c0-503d-49b0-9568-514f9f42c4c1', '40f5fbbc-7faf-4fb1-86ed-ae566e39b968'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:13 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:16:13 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:14 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.825s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:14 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:16:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Deleted volume successfully. Jul 03 16:16:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ce5f920-7f6d-444f-947f-18670f6bec5b tempest-TaggedAttachmentsTest-1849528113 None] Lock "cinder-e104bf81-bf93-4ded-ac7d-23118355ab05-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-45550e9f-6b1f-44b0-8f00-5bda29e76383 tempest-GroupsV314Test-595142072 None] Group tempest-GroupsV314Test-Group-1765030756: creating Jul 03 16:16:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-45550e9f-6b1f-44b0-8f00-5bda29e76383 tempest-GroupsV314Test-595142072 None] Group tempest-GroupsV314Test-Group-1765030756: created successfully Jul 03 16:16:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-45550e9f-6b1f-44b0-8f00-5bda29e76383 tempest-GroupsV314Test-595142072 None] Create group completed successfully. Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Flow 'volume_create_manager' (7061fac8-a5b2-44d8-8853-accde3ee8a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2cfe76-fc7c-4fad-a4dc-9add90c00259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2cfe76-fc7c-4fad-a4dc-9add90c00259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1615757907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=819176bc-fa0a-49cc-b18f-5722ce876ff6,host='devstack@QuobyteHD#QuobyteHD',id=3172c008-f3ce-4d03-9903-a07d27bdacff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056cee0309c048fa86e80aebb3f91e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:16:16Z,use_quota=True,user_id='f2f2485f8c6a437095999c52db91b463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa56db2e-c1c6-4a1c-a9d1-47af7cc6b007),volume_type_id=aa56db2e-c1c6-4a1c-a9d1-47af7cc6b007)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c26c08-d7ef-4f84-9f21-b7ac5a385753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c26c08-d7ef-4f84-9f21-b7ac5a385753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e678d09c-2533-4205-b308-047832d7a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e678d09c-2533-4205-b308-047832d7a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3172c008-f3ce-4d03-9903-a07d27bdacff', 'volume_name': 'volume-3172c008-f3ce-4d03-9903-a07d27bdacff', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f027608b-7aa7-4587-9f11-1944cbb8a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f027608b-7aa7-4587-9f11-1944cbb8a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed613896-d837-46eb-bbc2-0ed3f4ee0faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:16 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Volume 3172c008-f3ce-4d03-9903-a07d27bdacff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3172c008-f3ce-4d03-9903-a07d27bdacff', 'volume_size': 1} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=819176bc-fa0a-49cc-b18f-5722ce876ff6,created_at=2026-07-03T14:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1615757907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=819176bc-fa0a-49cc-b18f-5722ce876ff6,host='devstack@QuobyteHD#QuobyteHD',id=3172c008-f3ce-4d03-9903-a07d27bdacff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056cee0309c048fa86e80aebb3f91e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:16:16Z,use_quota=True,user_id='f2f2485f8c6a437095999c52db91b463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa56db2e-c1c6-4a1c-a9d1-47af7cc6b007),volume_type_id=aa56db2e-c1c6-4a1c-a9d1-47af7cc6b007)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Creating volume 3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:16:16 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:16:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:16 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff 1073741824 Jul 03 16:16:16 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:17 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff 1073741824" returned: 0 in 1.221s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:17 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff Jul 03 16:16:17 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:18 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff" returned: 0 in 0.861s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed613896-d837-46eb-bbc2-0ed3f4ee0faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3172c008-f3ce-4d03-9903-a07d27bdacff', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b3a480-f692-4ad2-9c1e-a38353f1a737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Volume volume-3172c008-f3ce-4d03-9903-a07d27bdacff (3172c008-f3ce-4d03-9903-a07d27bdacff): created successfully Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b3a480-f692-4ad2-9c1e-a38353f1a737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Flow 'volume_create_manager' (7061fac8-a5b2-44d8-8853-accde3ee8a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:16:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2751e612-f19b-424d-b5ab-348241496f9e tempest-GroupsV314Test-595142072 None] Created volume successfully. Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:18 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:16:18 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:19 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.742s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:16:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:16:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 8 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:16:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:16:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:20 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Cloning volume 3172c008-f3ce-4d03-9903-a07d27bdacff to volume 828d5d83-fe5c-4a93-8348-890d8a2a7e95 Jul 03 16:16:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Creating offline snapshot b56a58f6-1913-4572-99aa-118481d5b1ad of volume 3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:16:20 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c042e2-85d1-4558-91da-830b29f91458]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:20 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff Jul 03 16:16:20 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:21 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff" returned: 0 in 0.933s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:21 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad 1G Jul 03 16:16:21 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:22 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad 1G" returned: 0 in 1.067s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3172c008-f3ce-4d03-9903-a07d27bdacff -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:22 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3172c008-f3ce-4d03-9903-a07d27bdacff -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad Jul 03 16:16:22 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:23 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3172c008-f3ce-4d03-9903-a07d27bdacff -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad" returned: 0 in 1.101s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:23 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:16:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:23 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad Jul 03 16:16:23 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:24 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad" returned: 0 in 0.867s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:24 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.info Jul 03 16:16:24 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:24 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.info" returned: 0 in 0.755s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:24 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:16:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:24 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.info Jul 03 16:16:24 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Acquiring lock "cinder-6f0c1537-8f57-4c81-8b59-6590d7470a58-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Lock "cinder-6f0c1537-8f57-4c81-8b59-6590d7470a58-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Acquiring lock "cinder-quobyte-6f0c1537-8f57-4c81-8b59-6590d7470a58" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Lock "cinder-quobyte-6f0c1537-8f57-4c81-8b59-6590d7470a58" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37c36ad-5799-4406-9702-3f5538fd0722]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:25 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 Jul 03 16:16:25 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:25 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.info" returned: 0 in 0.855s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Acquiring lock "cinder-quobyte-828d5d83-fe5c-4a93-8348-890d8a2a7e95" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Lock "cinder-quobyte-828d5d83-fe5c-4a93-8348-890d8a2a7e95" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] snapshot: b56a58f6-1913-4572-99aa-118481d5b1ad, volume: 828d5d83-fe5c-4a93-8348-890d8a2a7e95, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a5c530-57b8-4e6f-b008-82a71fc985b9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:25 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad Jul 03 16:16:25 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:26 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58" returned: 0 in 0.921s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:26 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58 Jul 03 16:16:26 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Flow 'volume_create_manager' (84a028d4-551e-4f26-9a24-3f85f6276299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75eb6e6-7c2d-4acd-9bc8-d87607a7d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75eb6e6-7c2d-4acd-9bc8-d87607a7d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1211797406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4159e06-70d5-4824-99d3-8645d981b359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3249dbf2394a518e53a28a0d6012ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:16:26Z,use_quota=True,user_id='d2767c7763224d4fa97064cfdd89c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef572aff-b118-4300-bb47-774ff62cf789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef572aff-b118-4300-bb47-774ff62cf789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a860952-11e8-4c76-a9bf-60f86e4875c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a860952-11e8-4c76-a9bf-60f86e4875c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4159e06-70d5-4824-99d3-8645d981b359', 'volume_name': 'volume-f4159e06-70d5-4824-99d3-8645d981b359', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea3533c-8f35-4eac-9b7f-8a0a146070e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea3533c-8f35-4eac-9b7f-8a0a146070e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f97dc85-c335-49c8-bb53-8f833bdf625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Volume f4159e06-70d5-4824-99d3-8645d981b359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4159e06-70d5-4824-99d3-8645d981b359', 'volume_size': 1} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:26 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad" returned: 0 in 0.970s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3172c008-f3ce-4d03-9903-a07d27bdacff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eba5619-38b9-480b-9075-2cc2a6721e96]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:26 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6f0c1537-8f57-4c81-8b59-6590d7470a58" returned: 0 in 0.838s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Lock "cinder-quobyte-6f0c1537-8f57-4c81-8b59-6590d7470a58" released by "delete_volume" :: held 1.814s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:26 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff Jul 03 16:16:26 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:26 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Created reservations ['dbe47532-1d0d-4b2f-9e26-8fafadfd03b6', 'f18e146c-781b-4869-9520-1d96869ee330', '9378491a-f97d-4fd1-b05c-d1666dd96dc6', '52210ec4-7096-4ddb-b522-365baf5b2288'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:27 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:16:27 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:27 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.845s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:16:27 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Deleted volume successfully. Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-74b521e8-49ac-4c7f-adb2-96b6172e8cca tempest-ServerActionsTestOtherA-816298766 None] Lock "cinder-6f0c1537-8f57-4c81-8b59-6590d7470a58-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:27 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff" returned: 0 in 1.168s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:16:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:28 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 Jul 03 16:16:28 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:34 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95" returned: 0 in 6.935s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82f2f4d-2002-43b3-a9b5-a8251d1000c6]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:35 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff Jul 03 16:16:35 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:35 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff" returned: 0 in 0.964s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:35 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:16:35 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Converted 1024.00 MB image at 147.62 MB/s Jul 03 16:16:35 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:16:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:35 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 Jul 03 16:16:35 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:36 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95" returned: 0 in 0.725s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Lock "cinder-quobyte-828d5d83-fe5c-4a93-8348-890d8a2a7e95" released by "_copy_volume_from_snapshot" :: held 10.862s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Acquiring lock "cinder-quobyte-b56a58f6-1913-4572-99aa-118481d5b1ad" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Lock "cinder-quobyte-b56a58f6-1913-4572-99aa-118481d5b1ad" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Deleting offline snapshot b56a58f6-1913-4572-99aa-118481d5b1ad of volume 3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:16:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] snapshot_file for this snap is: volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:16:36 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[700547aa-81ad-40d5-be85-db8f14681b3b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:36 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad Jul 03 16:16:36 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:37 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=21,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:16:38 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad" returned: 0 in 1.306s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3172c008-f3ce-4d03-9903-a07d27bdacff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:16:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[087aeb7c-eaf7-43a5-8e95-aea485e66ca9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:38 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff Jul 03 16:16:38 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:39 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff" returned: 0 in 0.934s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:39 devstack sudo[92226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad Jul 03 16:16:39 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:40 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad" returned: 0 in 0.979s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:40 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad Jul 03 16:16:40 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:40 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff.b56a58f6-1913-4572-99aa-118481d5b1ad" returned: 0 in 0.758s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Lock "cinder-quobyte-b56a58f6-1913-4572-99aa-118481d5b1ad" released by "_delete_snapshot" :: held 4.102s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.823s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.315s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1211797406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4159e06-70d5-4824-99d3-8645d981b359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3249dbf2394a518e53a28a0d6012ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:16:26Z,use_quota=True,user_id='d2767c7763224d4fa97064cfdd89c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Creating volume f4159e06-70d5-4824-99d3-8645d981b359 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:16:40 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:16:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:40 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 1073741824 Jul 03 16:16:40 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:41 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e3073b45-76bb-4719-8cad-af5a4cd60a6b tempest-GroupsV314Test-595142072 None] Create group from source-group-819176bc-fa0a-49cc-b18f-5722ce876ff6 completed successfully. Jul 03 16:16:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Acquiring lock "cinder-quobyte-828d5d83-fe5c-4a93-8348-890d8a2a7e95" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Lock "cinder-quobyte-828d5d83-fe5c-4a93-8348-890d8a2a7e95" acquired by "delete_volume" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:41 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[199de858-11f6-4fc2-9c1e-af8bc62828dc]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:41 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 Jul 03 16:16:41 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:42 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 1073741824" returned: 0 in 1.331s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:42 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 Jul 03 16:16:42 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:43 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95" returned: 0 in 1.379s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:43 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95 Jul 03 16:16:43 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:43 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359" returned: 0 in 1.137s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] <== create_volume: return (2547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:16:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.554s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f97dc85-c335-49c8-bb53-8f833bdf625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4159e06-70d5-4824-99d3-8645d981b359', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68cb6092-9d90-45d7-ad55-d525ce279cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:43 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Volume volume-f4159e06-70d5-4824-99d3-8645d981b359 (f4159e06-70d5-4824-99d3-8645d981b359): created successfully Jul 03 16:16:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68cb6092-9d90-45d7-ad55-d525ce279cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Flow 'volume_create_manager' (84a028d4-551e-4f26-9a24-3f85f6276299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:16:43 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1887a257-c833-42ca-b92e-529738621690 tempest-AttachVolumeTestJSON-1070374690 None] Created volume successfully. Jul 03 16:16:44 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-828d5d83-fe5c-4a93-8348-890d8a2a7e95" returned: 0 in 0.859s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Lock "cinder-quobyte-828d5d83-fe5c-4a93-8348-890d8a2a7e95" released by "delete_volume" :: held 2.297s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Created reservations ['3b0843bf-1f09-4762-a39f-ec79a8d6b3fa'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:16:44 devstack cinder-volume[86659]: WARNING cinder.quota [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1741820129 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1741820129, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:16:44 devstack cinder-volume[86659]: WARNING cinder.quota [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1741820129 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1741820129, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Created reservations ['afecb624-771b-4b24-8182-b3276dd8f42b', 'dfd3261e-ff3c-49f2-98ee-53864c2d1e69', '7a0bddf6-91b3-4dcd-8859-b87dbcf6769b', '7d37b3a0-2688-4bde-853d-f7ae89b47219'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:44 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:16:44 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.885s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:45 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:16:45 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1fb376ea-9582-4834-8004-6b90f64f9131 tempest-GroupsV314Test-595142072 None] Delete group completed successfully. Jul 03 16:16:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Acquiring lock "cinder-quobyte-3172c008-f3ce-4d03-9903-a07d27bdacff" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:16:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Lock "cinder-quobyte-3172c008-f3ce-4d03-9903-a07d27bdacff" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:16:45 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd474f9d-1616-4786-8a44-51c5ef7540a9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:45 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff Jul 03 16:16:45 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:46 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff" returned: 0 in 0.833s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:46 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff Jul 03 16:16:46 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:47 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3172c008-f3ce-4d03-9903-a07d27bdacff" returned: 0 in 0.978s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Lock "cinder-quobyte-3172c008-f3ce-4d03-9903-a07d27bdacff" released by "delete_volume" :: held 1.918s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:16:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-f3734003-16c2-4d01-a4ca-83414944ec20 req-5d6eee7d-cfa8-4c4a-9b06-4963d1291063 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-f3734003-16c2-4d01-a4ca-83414944ec20 req-5d6eee7d-cfa8-4c4a-9b06-4963d1291063 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:47 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b8fecf-3602-4c32-b28f-d3438dd24350]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:16:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f3734003-16c2-4d01-a4ca-83414944ec20 req-5d6eee7d-cfa8-4c4a-9b06-4963d1291063 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:47 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Created reservations ['6ee69a16-aa41-4fcb-b6ec-cb2d76ea95c9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:16:47 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Created reservations ['3fe48eb4-5344-410b-8d22-1d57e1b8be4d', '389b4217-9d8b-49e2-8d46-d5ec672b8a48', 'e0810e31-5403-4888-93b0-3c4409797adb', '363c3575-7a2b-494a-b1cf-149bba4123ae'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:16:47 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 Jul 03 16:16:47 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:48 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:16:48 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:49 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f3734003-16c2-4d01-a4ca-83414944ec20 req-5d6eee7d-cfa8-4c4a-9b06-4963d1291063 tempest-AttachVolumeTestJSON-1070374690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359" returned: 0 in 1.321s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-f3734003-16c2-4d01-a4ca-83414944ec20 req-5d6eee7d-cfa8-4c4a-9b06-4963d1291063 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.362s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-f3734003-16c2-4d01-a4ca-83414944ec20 req-5d6eee7d-cfa8-4c4a-9b06-4963d1291063 tempest-AttachVolumeTestJSON-1070374690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-f4159e06-70d5-4824-99d3-8645d981b359', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51e741d7-0ab0-4fc1-99d8-e553d8291a51', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:16:49 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.148s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:49 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:16:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e7c0018b-9612-4c39-97b2-0c2f317c97b5 tempest-GroupsV314Test-595142072 None] Delete group completed successfully. Jul 03 16:16:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-f3734003-16c2-4d01-a4ca-83414944ec20 req-5d6eee7d-cfa8-4c4a-9b06-4963d1291063 tempest-AttachVolumeTestJSON-1070374690 None] attachment_update completed successfully. Jul 03 16:16:54 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:16:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Flow 'volume_create_manager' (4fcb01d7-e083-41c0-9217-0f697e2049ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:16:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7fb5e9-85b2-444a-9c72-aaeadf2d463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7fb5e9-85b2-444a-9c72-aaeadf2d463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1840080253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f1912f-2b06-41cf-8f72-fc4bac198d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3249dbf2394a518e53a28a0d6012ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:16:55Z,use_quota=True,user_id='d2767c7763224d4fa97064cfdd89c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd00bced-7df0-4f7b-9111-40779ad64ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd00bced-7df0-4f7b-9111-40779ad64ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601ea719-8ace-4418-a585-f2fca4f63044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601ea719-8ace-4418-a585-f2fca4f63044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f1912f-2b06-41cf-8f72-fc4bac198d7a', 'volume_name': 'volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd8d7f9-0b7b-4445-baad-89b05db82e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd8d7f9-0b7b-4445-baad-89b05db82e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17c2413-62ec-4051-bbf0-2ebe6752163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:55 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Volume 17f1912f-2b06-41cf-8f72-fc4bac198d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a', 'volume_size': 1} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1840080253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f1912f-2b06-41cf-8f72-fc4bac198d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3249dbf2394a518e53a28a0d6012ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:16:55Z,use_quota=True,user_id='d2767c7763224d4fa97064cfdd89c2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Creating volume 17f1912f-2b06-41cf-8f72-fc4bac198d7a {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:16:55 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:16:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:55 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a 1073741824 Jul 03 16:16:55 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:56 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a 1073741824" returned: 0 in 1.439s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:16:56 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a Jul 03 16:16:56 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:16:57 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Jul 03 16:16:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a" returned: 0 in 0.816s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:16:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:16:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:16:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17c2413-62ec-4051-bbf0-2ebe6752163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b43e86f-6706-4243-a305-3e7a7d0f4aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:16:57 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Volume volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a (17f1912f-2b06-41cf-8f72-fc4bac198d7a): created successfully Jul 03 16:16:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b43e86f-6706-4243-a305-3e7a7d0f4aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:16:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Flow 'volume_create_manager' (4fcb01d7-e083-41c0-9217-0f697e2049ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:16:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-315bc901-7222-4886-9de5-103f2ef10206 tempest-AttachVolumeTestJSON-1070374690 None] Created volume successfully. Jul 03 16:17:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-622d57e7-de20-48bc-b772-736d5ecb572a req-927da373-da44-4db6-a7a9-e11b0908f2e5 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-622d57e7-de20-48bc-b772-736d5ecb572a req-927da373-da44-4db6-a7a9-e11b0908f2e5 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c0d72c-3102-4ba1-b503-2737b925ffec]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:17:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-622d57e7-de20-48bc-b772-736d5ecb572a req-927da373-da44-4db6-a7a9-e11b0908f2e5 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:02 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a Jul 03 16:17:02 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:03 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-622d57e7-de20-48bc-b772-736d5ecb572a req-927da373-da44-4db6-a7a9-e11b0908f2e5 tempest-AttachVolumeTestJSON-1070374690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a" returned: 0 in 1.047s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-622d57e7-de20-48bc-b772-736d5ecb572a req-927da373-da44-4db6-a7a9-e11b0908f2e5 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.080s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-622d57e7-de20-48bc-b772-736d5ecb572a req-927da373-da44-4db6-a7a9-e11b0908f2e5 tempest-AttachVolumeTestJSON-1070374690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bad4d833-3ddf-49d5-a0e2-982a2dc80391', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:17:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-622d57e7-de20-48bc-b772-736d5ecb572a req-927da373-da44-4db6-a7a9-e11b0908f2e5 tempest-AttachVolumeTestJSON-1070374690 None] attachment_update completed successfully. Jul 03 16:17:10 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-8840d103-1ee9-4e62-8a24-00214d1029f4 req-1a103431-5ed1-43db-b5a1-b2c5ce008d08 tempest-AttachVolumeTestJSON-1070374690 None] Terminate volume connection completed successfully. Jul 03 16:17:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-8840d103-1ee9-4e62-8a24-00214d1029f4 req-1a103431-5ed1-43db-b5a1-b2c5ce008d08 tempest-AttachVolumeTestJSON-1070374690 None] Deleting attachment 51e741d7-0ab0-4fc1-99d8-e553d8291a51. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=44,cinder:INSERT=10,cinder:UPDATE=57,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Flow 'volume_create_manager' (6587e3a4-d1f0-4c49-8875-59cf2a93301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bbf142-5eac-440d-8713-1aa3f6d372fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bbf142-5eac-440d-8713-1aa3f6d372fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-725450653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71f93df-28a0-4aef-8f79-d2a29158c80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275977f9a17e4f11a61532102b3454b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:11Z,use_quota=True,user_id='dd9073c1f937435e9876a4831d4f1a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c5353e-59e6-4fe5-ae6c-e5b8ed02d8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c5353e-59e6-4fe5-ae6c-e5b8ed02d8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2788598e-44e5-4996-b4c5-e3f972003ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2788598e-44e5-4996-b4c5-e3f972003ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71f93df-28a0-4aef-8f79-d2a29158c80e', 'volume_name': 'volume-e71f93df-28a0-4aef-8f79-d2a29158c80e', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee303b86-199c-4835-8942-bfd22b2f5973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee303b86-199c-4835-8942-bfd22b2f5973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adfaf02-82d8-4522-b115-a633d8cd69ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:11 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Volume e71f93df-28a0-4aef-8f79-d2a29158c80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71f93df-28a0-4aef-8f79-d2a29158c80e', 'volume_size': 1} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-725450653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71f93df-28a0-4aef-8f79-d2a29158c80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275977f9a17e4f11a61532102b3454b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:11Z,use_quota=True,user_id='dd9073c1f937435e9876a4831d4f1a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Creating volume e71f93df-28a0-4aef-8f79-d2a29158c80e {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:17:11 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:17:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:11 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e 1073741824 Jul 03 16:17:11 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:13 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e 1073741824" returned: 0 in 1.672s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:13 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e Jul 03 16:17:13 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:13 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-1a6b707e-0a68-4f98-9740-887913057be0 req-b3259cfe-8879-49b0-8598-8806602738d9 tempest-AttachVolumeTestJSON-1070374690 None] Terminate volume connection completed successfully. Jul 03 16:17:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-1a6b707e-0a68-4f98-9740-887913057be0 req-b3259cfe-8879-49b0-8598-8806602738d9 tempest-AttachVolumeTestJSON-1070374690 None] Deleting attachment bad4d833-3ddf-49d5-a0e2-982a2dc80391. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:17:14 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e" returned: 0 in 1.592s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] <== create_volume: return (3382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:17:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.385s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adfaf02-82d8-4522-b115-a633d8cd69ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71f93df-28a0-4aef-8f79-d2a29158c80e', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9387a1-a4e5-4a01-adfc-b07afce4e284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:15 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Volume volume-e71f93df-28a0-4aef-8f79-d2a29158c80e (e71f93df-28a0-4aef-8f79-d2a29158c80e): created successfully Jul 03 16:17:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9387a1-a4e5-4a01-adfc-b07afce4e284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Flow 'volume_create_manager' (6587e3a4-d1f0-4c49-8875-59cf2a93301e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-174a0513-9d11-46eb-8206-5ad483e5b468 tempest-VolumesTransfersTest-1426151958 None] Created volume successfully. Jul 03 16:17:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0ea3b9f2-59af-4ebf-9f53-a81ca5f98b05 tempest-VolumesTransfersTest-1038533923 None] Transfer volume completed successfully. Jul 03 16:17:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:17:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:19 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:17:19 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:20 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.649s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 8 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Acquiring lock "cinder-e71f93df-28a0-4aef-8f79-d2a29158c80e-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Lock "cinder-e71f93df-28a0-4aef-8f79-d2a29158c80e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Acquiring lock "cinder-quobyte-e71f93df-28a0-4aef-8f79-d2a29158c80e" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Lock "cinder-quobyte-e71f93df-28a0-4aef-8f79-d2a29158c80e" acquired by "delete_volume" :: waited 0.060s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee788c8-24da-4b93-a69a-ec71fb5f9831]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:17:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:21 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e Jul 03 16:17:21 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:22 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e" returned: 0 in 1.602s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:22 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e Jul 03 16:17:22 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:23 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e71f93df-28a0-4aef-8f79-d2a29158c80e" returned: 0 in 1.101s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Lock "cinder-quobyte-e71f93df-28a0-4aef-8f79-d2a29158c80e" released by "delete_volume" :: held 2.798s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:23 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Created reservations ['6c2ce8c3-31c4-4755-89d1-ca32f9878c80', '0d1c3042-9a77-4f70-8b41-770257202986', '9f351fb3-614f-45ed-b508-6cd035aadc55', '925f7ee8-3a79-4fd8-ba07-cdaf2a497d1d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:17:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:23 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:17:23 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:25 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.226s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:17:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Deleted volume successfully. Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcc5b730-2653-4fc2-997b-12c228b0ca7e tempest-VolumesTransfersTest-1529299022 None] Lock "cinder-e71f93df-28a0-4aef-8f79-d2a29158c80e-delete_volume" released by "delete_volume" :: held 4.475s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Flow 'volume_create_manager' (5e6cdb3f-eca2-490d-87ba-607e78d33fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3a0bd5-731a-4e29-ab3b-ac2de2d87289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3a0bd5-731a-4e29-ab3b-ac2de2d87289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-102550533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b69e201-8029-479d-9e90-a9aa15f29e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275977f9a17e4f11a61532102b3454b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:25Z,use_quota=True,user_id='dd9073c1f937435e9876a4831d4f1a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dee865e-0519-4b01-ade8-bc4f6f47e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dee865e-0519-4b01-ade8-bc4f6f47e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e432561-d831-4c5b-81c9-5fc432602285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e432561-d831-4c5b-81c9-5fc432602285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b69e201-8029-479d-9e90-a9aa15f29e8a', 'volume_name': 'volume-2b69e201-8029-479d-9e90-a9aa15f29e8a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044d92c7-8695-47f8-a1bc-0783d9123822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044d92c7-8695-47f8-a1bc-0783d9123822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db11274f-0ede-4671-aba0-76cae206bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:25 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Volume 2b69e201-8029-479d-9e90-a9aa15f29e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b69e201-8029-479d-9e90-a9aa15f29e8a', 'volume_size': 1} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-102550533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b69e201-8029-479d-9e90-a9aa15f29e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275977f9a17e4f11a61532102b3454b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:25Z,use_quota=True,user_id='dd9073c1f937435e9876a4831d4f1a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Creating volume 2b69e201-8029-479d-9e90-a9aa15f29e8a {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:17:25 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:17:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:25 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a 1073741824 Jul 03 16:17:25 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:26 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a 1073741824" returned: 0 in 1.427s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:26 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a Jul 03 16:17:26 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:27 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a" returned: 0 in 1.009s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] <== create_volume: return (2501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:17:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.503s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db11274f-0ede-4671-aba0-76cae206bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b69e201-8029-479d-9e90-a9aa15f29e8a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb763f29-58f7-4bee-bed0-373bf03ea0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:28 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Volume volume-2b69e201-8029-479d-9e90-a9aa15f29e8a (2b69e201-8029-479d-9e90-a9aa15f29e8a): created successfully Jul 03 16:17:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb763f29-58f7-4bee-bed0-373bf03ea0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Flow 'volume_create_manager' (5e6cdb3f-eca2-490d-87ba-607e78d33fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-31477abf-182a-4cc0-aefe-822456507b1e tempest-VolumesTransfersTest-1426151958 None] Created volume successfully. Jul 03 16:17:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Acquiring lock "cinder-2b69e201-8029-479d-9e90-a9aa15f29e8a-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Lock "cinder-2b69e201-8029-479d-9e90-a9aa15f29e8a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Acquiring lock "cinder-quobyte-2b69e201-8029-479d-9e90-a9aa15f29e8a" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Lock "cinder-quobyte-2b69e201-8029-479d-9e90-a9aa15f29e8a" acquired by "delete_volume" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:29 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bace3f17-500d-483e-8192-5367f6d35a48]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:17:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:29 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a Jul 03 16:17:29 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "cinder-17f1912f-2b06-41cf-8f72-fc4bac198d7a-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-17f1912f-2b06-41cf-8f72-fc4bac198d7a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "cinder-quobyte-17f1912f-2b06-41cf-8f72-fc4bac198d7a" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-quobyte-17f1912f-2b06-41cf-8f72-fc4bac198d7a" acquired by "delete_volume" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:29 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4f9bd-0a49-4220-b312-66a1e7e47f5b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:17:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:29 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a Jul 03 16:17:29 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:30 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a" returned: 0 in 1.277s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:30 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a Jul 03 16:17:30 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:31 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a" returned: 0 in 2.119s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:31 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a Jul 03 16:17:31 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:31 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2b69e201-8029-479d-9e90-a9aa15f29e8a" returned: 0 in 1.507s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Lock "cinder-quobyte-2b69e201-8029-479d-9e90-a9aa15f29e8a" released by "delete_volume" :: held 2.888s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:31 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Created reservations ['9068f1aa-63d2-401c-aa9d-da065af937bd', '92e29fc2-f0a7-43ac-ab29-def55e7fc009', 'e8735d35-e1d2-4701-89f4-1b66d2fc2f53', 'feebb749-1ca6-46ef-a88e-e9fdd5c94470'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:17:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:32 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:17:32 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:33 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-17f1912f-2b06-41cf-8f72-fc4bac198d7a" returned: 0 in 1.520s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-quobyte-17f1912f-2b06-41cf-8f72-fc4bac198d7a" released by "delete_volume" :: held 3.762s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Created reservations ['658fca6e-caa2-4fe7-af37-cbed9cb9e6f2', 'a0a5a0e1-7564-4fc7-a414-8892c7413981', 'ffd30d51-e5da-47de-bbf0-fdd2ee53c22f', 'f7669305-7100-490d-a7e5-ab0937f691bb'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:33 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:17:33 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:33 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.510s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:17:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Deleted volume successfully. Jul 03 16:17:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-75f61809-dec9-46f8-baf7-658a1aed3270 tempest-VolumesTransfersTest-1529299022 None] Lock "cinder-2b69e201-8029-479d-9e90-a9aa15f29e8a-delete_volume" released by "delete_volume" :: held 4.863s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "cinder-f4159e06-70d5-4824-99d3-8645d981b359-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-f4159e06-70d5-4824-99d3-8645d981b359-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "cinder-quobyte-f4159e06-70d5-4824-99d3-8645d981b359" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-quobyte-f4159e06-70d5-4824-99d3-8645d981b359" acquired by "delete_volume" :: waited 0.047s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe61bb1-2905-4e04-913a-124358d5915b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:17:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:34 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.958s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:34 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:17:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Deleted volume successfully. Jul 03 16:17:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5adf95b-16e6-4ca7-99fa-ab9cbf5fba9d tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-17f1912f-2b06-41cf-8f72-fc4bac198d7a-delete_volume" released by "delete_volume" :: held 5.116s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:34 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 Jul 03 16:17:34 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Flow 'volume_create_manager' (f7b42ea8-f0ac-456e-acaa-ba7a396ffb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7257b9b6-4a8a-4d49-8a40-313149f2648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7257b9b6-4a8a-4d49-8a40-313149f2648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-263111899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c164ff2-b26c-49f7-9a8d-9d18201c9567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e04f70dd4141f0af2a4c1802b0f747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:35Z,use_quota=True,user_id='901ae1c6bd1748d59097e188b458e7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a5fbeb-eb91-4b80-ad84-b7a7324e47ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a5fbeb-eb91-4b80-ad84-b7a7324e47ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd56038-5741-4e3f-9b11-d4e929805766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd56038-5741-4e3f-9b11-d4e929805766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c164ff2-b26c-49f7-9a8d-9d18201c9567', 'volume_name': 'volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4770f468-a270-423d-a62d-b7dcced8cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4770f468-a270-423d-a62d-b7dcced8cc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c02f489-44fc-476a-a556-a74e6191cacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:35 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Volume 4c164ff2-b26c-49f7-9a8d-9d18201c9567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567', 'volume_size': 1} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-263111899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c164ff2-b26c-49f7-9a8d-9d18201c9567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e04f70dd4141f0af2a4c1802b0f747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:35Z,use_quota=True,user_id='901ae1c6bd1748d59097e188b458e7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Creating volume 4c164ff2-b26c-49f7-9a8d-9d18201c9567 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:17:35 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:35 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 1073741824 Jul 03 16:17:35 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:35 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359" returned: 0 in 1.227s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:35 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359 Jul 03 16:17:35 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:36 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f4159e06-70d5-4824-99d3-8645d981b359" returned: 0 in 0.823s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-quobyte-f4159e06-70d5-4824-99d3-8645d981b359" released by "delete_volume" :: held 2.179s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:36 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 1073741824" returned: 0 in 1.213s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Created reservations ['27b8be37-3dd6-4bfd-88c9-a442f52c4d3d', 'a601ec46-b3e2-48e6-a8ce-518566b63566', 'ad56fd13-b9c6-4e30-bbc9-711eba885de0', '7088aa1c-773f-43b6-a7b3-ea12ad5af44e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:36 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 Jul 03 16:17:36 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:36 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:17:36 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:37 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.118s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:37 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:17:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Deleted volume successfully. Jul 03 16:17:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0cf21c66-d8f6-49cf-985f-69831629f5f4 tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-f4159e06-70d5-4824-99d3-8645d981b359-delete_volume" released by "delete_volume" :: held 3.704s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "cinder-11365b83-0897-4476-9af6-9f0d2e57f5c7-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-11365b83-0897-4476-9af6-9f0d2e57f5c7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=68,cinder:SELECT=71,cinder:DELETE=5,cinder:INSERT=16 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "cinder-quobyte-11365b83-0897-4476-9af6-9f0d2e57f5c7" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-quobyte-11365b83-0897-4476-9af6-9f0d2e57f5c7" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:38 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567" returned: 0 in 1.674s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] <== create_volume: return (2962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.965s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c02f489-44fc-476a-a556-a74e6191cacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf207573-d169-4720-993c-afb31cc0a7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153c4f8-f2c8-4759-8200-c7132b2dd325]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Volume volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 (4c164ff2-b26c-49f7-9a8d-9d18201c9567): created successfully Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf207573-d169-4720-993c-afb31cc0a7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Flow 'volume_create_manager' (f7b42ea8-f0ac-456e-acaa-ba7a396ffb4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6244e188-e490-4ef2-a154-f63afcea3501 tempest-AttachVolumeShelveTestJSON-100876405 None] Created volume successfully. Jul 03 16:17:38 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 Jul 03 16:17:38 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:39 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7" returned: 0 in 1.272s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:39 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7 Jul 03 16:17:39 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:40 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-11365b83-0897-4476-9af6-9f0d2e57f5c7" returned: 0 in 1.324s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-quobyte-11365b83-0897-4476-9af6-9f0d2e57f5c7" released by "delete_volume" :: held 2.715s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:40 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Created reservations ['8114d167-08e7-4560-b749-168e0181b06b', 'b844179f-ccf2-4543-bc9b-10a10e310232', '5df28be0-62fd-4649-b845-b86815ff6dfb', '9aa295da-c12d-463a-876f-7feef397b620'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:17:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:41 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:17:41 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Flow 'volume_create_manager' (6b16b806-380d-4782-9464-c245241618cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13780e6e-33a4-45a5-9da9-ba1872e556bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13780e6e-33a4-45a5-9da9-ba1872e556bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2000055531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0aedaaa-3505-4f5d-8b35-ee4135975bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af89e53b90844519f9a72e01e62bedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:42Z,use_quota=True,user_id='6008cc9f52944273a137863c1816e8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764bbbde-50e1-4b79-ae10-76451f0e44bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764bbbde-50e1-4b79-ae10-76451f0e44bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef5cd74-6cbd-4d87-a914-efab2d0840a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef5cd74-6cbd-4d87-a914-efab2d0840a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0aedaaa-3505-4f5d-8b35-ee4135975bdc', 'volume_name': 'volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b41eb8-919b-43da-a2cc-47b3e1c1c3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b41eb8-919b-43da-a2cc-47b3e1c1c3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367fc76f-77c1-4205-aa9b-02ec5c773670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:42 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Volume e0aedaaa-3505-4f5d-8b35-ee4135975bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc', 'volume_size': 1} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2000055531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0aedaaa-3505-4f5d-8b35-ee4135975bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af89e53b90844519f9a72e01e62bedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:42Z,use_quota=True,user_id='6008cc9f52944273a137863c1816e8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Creating volume e0aedaaa-3505-4f5d-8b35-ee4135975bdc {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:17:42 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:42 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.567s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:17:42 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Deleted volume successfully. Jul 03 16:17:42 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc 1073741824 Jul 03 16:17:42 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4bbb278-8716-400a-9309-218d445adefc tempest-AttachVolumeTestJSON-1070374690 None] Lock "cinder-11365b83-0897-4476-9af6-9f0d2e57f5c7-delete_volume" released by "delete_volume" :: held 4.785s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:44 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc 1073741824" returned: 0 in 1.473s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:44 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc Jul 03 16:17:44 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:45 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc" returned: 0 in 1.463s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] <== create_volume: return (3011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:17:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367fc76f-77c1-4205-aa9b-02ec5c773670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0957a5f7-62d7-4526-ae0f-8862de4d9915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:45 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Volume volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc (e0aedaaa-3505-4f5d-8b35-ee4135975bdc): created successfully Jul 03 16:17:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0957a5f7-62d7-4526-ae0f-8862de4d9915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Flow 'volume_create_manager' (6b16b806-380d-4782-9464-c245241618cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fb4bfe0a-6541-4286-8407-8cb37e6622af tempest-ServerRescueNegativeTestJSON-706985072 None] Created volume successfully. Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Flow 'volume_create_manager' (3508be46-3080-4fff-b0ee-2cc2996effb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b92f0b-9dcd-44b4-b204-9db0721bcb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b92f0b-9dcd-44b4-b204-9db0721bcb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-374608836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d270fe-6331-4a9a-8d5d-54f81dd0663d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbdcb707f2b43cc9d8b7de0edfd69e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:47Z,use_quota=True,user_id='d68949af85444c23994b209f0351a9e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90afba31-fca9-416c-8f5f-5fa5be0d41fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90afba31-fca9-416c-8f5f-5fa5be0d41fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df44210-3419-4a7c-a36c-f1af37f86605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df44210-3419-4a7c-a36c-f1af37f86605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d270fe-6331-4a9a-8d5d-54f81dd0663d', 'volume_name': 'volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1e8216-10ba-4242-8f1d-babd747ae2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1e8216-10ba-4242-8f1d-babd747ae2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23879b24-6abf-4d1a-8a6a-f6606802b70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:47 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Volume 54d270fe-6331-4a9a-8d5d-54f81dd0663d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d', 'volume_size': 1} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-374608836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d270fe-6331-4a9a-8d5d-54f81dd0663d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbdcb707f2b43cc9d8b7de0edfd69e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:47Z,use_quota=True,user_id='d68949af85444c23994b209f0351a9e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Creating volume 54d270fe-6331-4a9a-8d5d-54f81dd0663d {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:17:47 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:17:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:47 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d 1073741824 Jul 03 16:17:47 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:49 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d 1073741824" returned: 0 in 1.830s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:49 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d Jul 03 16:17:49 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:50 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d" returned: 0 in 1.506s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] <== create_volume: return (3408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:17:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.412s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23879b24-6abf-4d1a-8a6a-f6606802b70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4723633-db0e-49c3-82a2-bc9824beda0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:50 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Volume volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d (54d270fe-6331-4a9a-8d5d-54f81dd0663d): created successfully Jul 03 16:17:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4723633-db0e-49c3-82a2-bc9824beda0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Flow 'volume_create_manager' (3508be46-3080-4fff-b0ee-2cc2996effb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:50 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3f64c440-3a58-447c-a275-0140f86bf483 tempest-VolumesTransfersV357Test-1812044458 None] Created volume successfully. Jul 03 16:17:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f73b1435-6802-4b6e-a949-c5d68702aacf tempest-VolumesTransfersV357Test-1932328005 None] Transfer volume completed successfully. Jul 03 16:17:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Acquiring lock "cinder-54d270fe-6331-4a9a-8d5d-54f81dd0663d-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Lock "cinder-54d270fe-6331-4a9a-8d5d-54f81dd0663d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Acquiring lock "cinder-quobyte-54d270fe-6331-4a9a-8d5d-54f81dd0663d" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:17:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Lock "cinder-quobyte-54d270fe-6331-4a9a-8d5d-54f81dd0663d" acquired by "delete_volume" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:17:55 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4edb09-40c6-4bb8-97e8-75fd5a114936]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:17:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:55 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d Jul 03 16:17:55 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:55 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d" returned: 0 in 0.869s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:56 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d Jul 03 16:17:56 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-39eea2a2-3956-40ca-97af-8bb6b954b1ac tempest-BackendsCapabilitiesAdminTestsJSON-1212369898 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86659) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 16:17:56 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-54d270fe-6331-4a9a-8d5d-54f81dd0663d" returned: 0 in 0.682s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Lock "cinder-quobyte-54d270fe-6331-4a9a-8d5d-54f81dd0663d" released by "delete_volume" :: held 1.608s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Created reservations ['9ec06848-52cd-4a07-b5d3-d40d60a23800', '8c9fa652-2114-4560-a9a0-73ec93b8cc6d', 'd3f19517-6f68-4da9-93f7-629f48038f1a', 'a2f3dd01-b0e1-4dc2-a033-a48c9ea3442b'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:56 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:17:56 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:17:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f013c5a-5773-423b-a79b-909e157dfb84 tempest-BackendsCapabilitiesAdminTestsJSON-1212369898 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86659) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 16:17:58 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.402s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:17:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Deleted volume successfully. Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-21794c54-7dfe-4115-b035-01d42e524501 tempest-VolumesTransfersV357Test-1011780982 None] Lock "cinder-54d270fe-6331-4a9a-8d5d-54f81dd0663d-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Flow 'volume_create_manager' (dd2bb781-a69d-47b9-b567-71b5e7fc1f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05de9746-1519-4f65-914d-27b0e5d947c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05de9746-1519-4f65-914d-27b0e5d947c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1080259342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e6d346-90af-4add-86a2-8af158568c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbdcb707f2b43cc9d8b7de0edfd69e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:58Z,use_quota=True,user_id='d68949af85444c23994b209f0351a9e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88839f27-474c-42fb-8cbc-a95cf027d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88839f27-474c-42fb-8cbc-a95cf027d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e730dd5d-1d9c-4ec9-a34c-6d47b9bd65d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e730dd5d-1d9c-4ec9-a34c-6d47b9bd65d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e6d346-90af-4add-86a2-8af158568c79', 'volume_name': 'volume-a9e6d346-90af-4add-86a2-8af158568c79', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a3e46f-0730-4dfa-b6f6-ac5ad79e2ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a3e46f-0730-4dfa-b6f6-ac5ad79e2ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdbe8c7-a792-4a8a-88f2-9d64f681ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:17:58 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Volume a9e6d346-90af-4add-86a2-8af158568c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e6d346-90af-4add-86a2-8af158568c79', 'volume_size': 1} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1080259342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e6d346-90af-4add-86a2-8af158568c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbdcb707f2b43cc9d8b7de0edfd69e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:17:58Z,use_quota=True,user_id='d68949af85444c23994b209f0351a9e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Creating volume a9e6d346-90af-4add-86a2-8af158568c79 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:17:58 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:17:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:17:58 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79 1073741824 Jul 03 16:17:58 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:00 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79 1073741824" returned: 0 in 2.068s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:00 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79 Jul 03 16:18:00 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-91abdaa4-591a-4f9f-8c9d-a266ebe29c95 req-479db0e2-4a07-4f0f-a18a-94c440103dd1 tempest-AttachVolumeShelveTestJSON-100876405 None] No connector for attachment 3efd0d4e-e14f-4333-a0f8-9f257008325b; skipping storage backend terminate_connection call. {{(pid=86659) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 03 16:18:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-91abdaa4-591a-4f9f-8c9d-a266ebe29c95 req-479db0e2-4a07-4f0f-a18a-94c440103dd1 tempest-AttachVolumeShelveTestJSON-100876405 None] Deleting attachment 3efd0d4e-e14f-4333-a0f8-9f257008325b. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:18:02 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79" returned: 0 in 1.228s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] <== create_volume: return (3427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:18:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.431s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdbe8c7-a792-4a8a-88f2-9d64f681ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e6d346-90af-4add-86a2-8af158568c79', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562ca464-d174-4e7e-86f9-0b94872987d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:02 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Volume volume-a9e6d346-90af-4add-86a2-8af158568c79 (a9e6d346-90af-4add-86a2-8af158568c79): created successfully Jul 03 16:18:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562ca464-d174-4e7e-86f9-0b94872987d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Flow 'volume_create_manager' (dd2bb781-a69d-47b9-b567-71b5e7fc1f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:18:02 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c4bd628e-0227-4068-963e-90d70c6b0937 tempest-VolumesTransfersV357Test-1812044458 None] Created volume successfully. Jul 03 16:18:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Acquiring lock "cinder-a9e6d346-90af-4add-86a2-8af158568c79-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:18:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Lock "cinder-a9e6d346-90af-4add-86a2-8af158568c79-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:18:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Acquiring lock "cinder-quobyte-a9e6d346-90af-4add-86a2-8af158568c79" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:18:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Lock "cinder-quobyte-a9e6d346-90af-4add-86a2-8af158568c79" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:18:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a422fe-5d56-430e-9ad2-3b4aafe6d40e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:18:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:03 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79 Jul 03 16:18:03 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:05 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79" returned: 0 in 1.472s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:05 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79 Jul 03 16:18:05 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:06 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a9e6d346-90af-4add-86a2-8af158568c79" returned: 0 in 1.403s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Lock "cinder-quobyte-a9e6d346-90af-4add-86a2-8af158568c79" released by "delete_volume" :: held 3.006s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:18:06 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Created reservations ['9c12800b-8146-4192-847c-98b07e826dc2', 'af9c3b0e-ffdb-4933-bd26-ee6eef22aa90', '6b0a8402-08ae-4f44-87e7-b74b40b2d1be', 'a5f1cd98-3592-4812-8754-1708617b95cb'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:18:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:06 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:18:06 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:08 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.439s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:08 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:18:08 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Deleted volume successfully. Jul 03 16:18:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-46ee1f1f-27da-4a78-b9a4-0194cf3a2abc tempest-VolumesTransfersV357Test-1011780982 None] Lock "cinder-a9e6d346-90af-4add-86a2-8af158568c79-delete_volume" released by "delete_volume" :: held 4.803s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:18:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Acquiring lock "cinder-e0aedaaa-3505-4f5d-8b35-ee4135975bdc-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:18:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "cinder-e0aedaaa-3505-4f5d-8b35-ee4135975bdc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:18:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Acquiring lock "cinder-quobyte-e0aedaaa-3505-4f5d-8b35-ee4135975bdc" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:18:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "cinder-quobyte-e0aedaaa-3505-4f5d-8b35-ee4135975bdc" acquired by "delete_volume" :: waited 0.040s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:18:09 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[666c7e7e-f1bc-418a-b3a5-0e6cde57379b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:18:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:09 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc Jul 03 16:18:09 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:10 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc" returned: 0 in 1.302s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:10 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc Jul 03 16:18:10 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:11 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e0aedaaa-3505-4f5d-8b35-ee4135975bdc" returned: 0 in 1.300s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "cinder-quobyte-e0aedaaa-3505-4f5d-8b35-ee4135975bdc" released by "delete_volume" :: held 2.697s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=50,cinder:INSERT=17,cinder:UPDATE=81,cinder:DELETE=5 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Created reservations ['05a9dc7e-4aa1-492c-95de-5f5576b91250', 'd46a4080-08eb-4d46-b79a-a959e1443c85', '53902c79-d42b-4647-abb3-5c7b060dad6b', '4fb5d332-8aa3-4bf9-a428-692d817551e6'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:12 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:18:12 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:13 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.181s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:13 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:18:13 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Deleted volume successfully. Jul 03 16:18:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9df7f9a-710c-4b46-b0dd-07d1911101d2 tempest-ServerRescueNegativeTestJSON-706985072 None] Lock "cinder-e0aedaaa-3505-4f5d-8b35-ee4135975bdc-delete_volume" released by "delete_volume" :: held 4.346s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:18:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:18:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:18 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:18:18 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:19 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-52d2ce22-f193-40b7-b5d7-ad1b01f10be5 tempest-GroupsTest-586163653 None] Group tempest-Group1-1822268605: creating Jul 03 16:18:19 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-52d2ce22-f193-40b7-b5d7-ad1b01f10be5 tempest-GroupsTest-586163653 None] Group tempest-Group1-1822268605: created successfully Jul 03 16:18:19 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-52d2ce22-f193-40b7-b5d7-ad1b01f10be5 tempest-GroupsTest-586163653 None] Create group completed successfully. Jul 03 16:18:20 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.841s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:18:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:18:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 8 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:18:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:18:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3be451f9-f75b-438b-bf03-b5745efa0f39 tempest-GroupsTest-586163653 None] Group tempest-Group2-1917688042: creating Jul 03 16:18:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3be451f9-f75b-438b-bf03-b5745efa0f39 tempest-GroupsTest-586163653 None] Group tempest-Group2-1917688042: created successfully Jul 03 16:18:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3be451f9-f75b-438b-bf03-b5745efa0f39 tempest-GroupsTest-586163653 None] Create group completed successfully. Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Flow 'volume_create_manager' (7c2f8448-74a5-4fb0-adfc-6da15291eded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621d755f-19f6-44fa-94eb-924592713989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621d755f-19f6-44fa-94eb-924592713989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1043018984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=235d6cc2-684a-4176-afa8-492626db45a8,host='devstack@QuobyteHD#QuobyteHD',id=c93b3e33-044e-4454-8816-419c26a90311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3aaec8c05534bf9b6069310831f4466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:18:23Z,use_quota=True,user_id='be485c687d8a41cb837146f6f611cb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5b51a86-71a4-4bf1-9dd7-56e8380bc997),volume_type_id=b5b51a86-71a4-4bf1-9dd7-56e8380bc997)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dcf767-37fd-4dbb-b57b-f22dc70f5970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dcf767-37fd-4dbb-b57b-f22dc70f5970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0669a9be-13bb-4371-82a9-b4acc3ee02f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0669a9be-13bb-4371-82a9-b4acc3ee02f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93b3e33-044e-4454-8816-419c26a90311', 'volume_name': 'volume-c93b3e33-044e-4454-8816-419c26a90311', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eae032-0c81-45dc-90eb-0a4349675c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eae032-0c81-45dc-90eb-0a4349675c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177f3760-9c78-4312-a0dc-66a4928b9a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:23 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Volume c93b3e33-044e-4454-8816-419c26a90311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93b3e33-044e-4454-8816-419c26a90311', 'volume_size': 1} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=235d6cc2-684a-4176-afa8-492626db45a8,created_at=2026-07-03T14:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1043018984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=235d6cc2-684a-4176-afa8-492626db45a8,host='devstack@QuobyteHD#QuobyteHD',id=c93b3e33-044e-4454-8816-419c26a90311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3aaec8c05534bf9b6069310831f4466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:18:23Z,use_quota=True,user_id='be485c687d8a41cb837146f6f611cb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5b51a86-71a4-4bf1-9dd7-56e8380bc997),volume_type_id=b5b51a86-71a4-4bf1-9dd7-56e8380bc997)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Creating volume c93b3e33-044e-4454-8816-419c26a90311 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:18:23 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:18:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:23 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311 1073741824 Jul 03 16:18:23 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:24 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311 1073741824" returned: 0 in 1.348s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:24 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311 Jul 03 16:18:24 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:25 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311" returned: 0 in 0.893s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:18:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177f3760-9c78-4312-a0dc-66a4928b9a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93b3e33-044e-4454-8816-419c26a90311', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18829f50-5993-4641-a786-8f2fec265346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:25 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Volume volume-c93b3e33-044e-4454-8816-419c26a90311 (c93b3e33-044e-4454-8816-419c26a90311): created successfully Jul 03 16:18:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18829f50-5993-4641-a786-8f2fec265346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Flow 'volume_create_manager' (7c2f8448-74a5-4fb0-adfc-6da15291eded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:18:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-93f6d2d4-f58f-4c9d-ab0a-cfd34cb4331d tempest-GroupsTest-586163653 None] Created volume successfully. Jul 03 16:18:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Acquiring lock "cinder-quobyte-c93b3e33-044e-4454-8816-419c26a90311" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:18:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Lock "cinder-quobyte-c93b3e33-044e-4454-8816-419c26a90311" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:18:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2421cf6b-092c-4278-a4ad-478501fe37f1]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:18:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:27 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311 Jul 03 16:18:27 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:27 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311" returned: 0 in 0.850s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:27 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311 Jul 03 16:18:27 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:28 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c93b3e33-044e-4454-8816-419c26a90311" returned: 0 in 0.785s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Lock "cinder-quobyte-c93b3e33-044e-4454-8816-419c26a90311" released by "delete_volume" :: held 1.695s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:18:28 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Created reservations ['fa6cd27b-e699-4d67-b1e6-8a6f4a1c7f81'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:18:28 devstack cinder-volume[86659]: WARNING cinder.quota [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1992298363 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1992298363, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:18:28 devstack cinder-volume[86659]: WARNING cinder.quota [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1992298363 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1992298363, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:18:28 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Created reservations ['ce939472-deab-49ab-b2c1-c7f5336af42a', 'bd111448-d0b2-413c-bfbb-a8a5be457528', 'ae3d9891-8b55-4eb1-af4a-406ca9af9364', 'dfaf0c58-0506-4bb9-9797-40d0a52d0573'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:29 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:18:29 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] Created reservations ['623f4ab4-9f57-4535-b598-340a84d887ef'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:29 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:18:29 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:30 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.334s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:30 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:18:30 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e9156ba1-28f7-43af-b8eb-40486fb6b72a tempest-GroupsTest-586163653 None] Delete group completed successfully. Jul 03 16:18:31 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.116s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:31 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:18:31 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0cfcd062-20da-4ad4-93b6-9a59c83e7f57 tempest-GroupsTest-586163653 None] Delete group completed successfully. Jul 03 16:18:31 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ebe05590-be1d-4292-b47c-4d41ae520475 tempest-GroupsTest-586163653 None] Group tempest-GroupsTest-Group-72727945: creating Jul 03 16:18:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ebe05590-be1d-4292-b47c-4d41ae520475 tempest-GroupsTest-586163653 None] Group tempest-GroupsTest-Group-72727945: created successfully Jul 03 16:18:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ebe05590-be1d-4292-b47c-4d41ae520475 tempest-GroupsTest-586163653 None] Create group completed successfully. Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Flow 'volume_create_manager' (3d97fada-aae9-4b24-952d-d983bcf1442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0248f852-c1bf-4a36-93d2-26458d99d131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0248f852-c1bf-4a36-93d2-26458d99d131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721029389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=621cc5b1-46c1-417f-9ece-8255a6322dca,host='devstack@QuobyteHD#QuobyteHD',id=1a29e3a9-edd3-40b7-a107-03a2d658889c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3aaec8c05534bf9b6069310831f4466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:18:34Z,use_quota=True,user_id='be485c687d8a41cb837146f6f611cb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(582534d4-f877-4090-a8ab-3b423f70a5ae),volume_type_id=582534d4-f877-4090-a8ab-3b423f70a5ae)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e08eec-407f-45f0-a593-bd175d721896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e08eec-407f-45f0-a593-bd175d721896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b13813-e765-40b7-ba3b-2b2bc2862e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b13813-e765-40b7-ba3b-2b2bc2862e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a29e3a9-edd3-40b7-a107-03a2d658889c', 'volume_name': 'volume-1a29e3a9-edd3-40b7-a107-03a2d658889c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c638f164-331e-47ef-be2c-0e76cb98cd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c638f164-331e-47ef-be2c-0e76cb98cd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d49315f-0275-4d28-a5be-af3d48f355b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:34 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Volume 1a29e3a9-edd3-40b7-a107-03a2d658889c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a29e3a9-edd3-40b7-a107-03a2d658889c', 'volume_size': 1} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=621cc5b1-46c1-417f-9ece-8255a6322dca,created_at=2026-07-03T14:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721029389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=621cc5b1-46c1-417f-9ece-8255a6322dca,host='devstack@QuobyteHD#QuobyteHD',id=1a29e3a9-edd3-40b7-a107-03a2d658889c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3aaec8c05534bf9b6069310831f4466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:18:34Z,use_quota=True,user_id='be485c687d8a41cb837146f6f611cb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(582534d4-f877-4090-a8ab-3b423f70a5ae),volume_type_id=582534d4-f877-4090-a8ab-3b423f70a5ae)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Creating volume 1a29e3a9-edd3-40b7-a107-03a2d658889c {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:18:34 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:18:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:34 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c 1073741824 Jul 03 16:18:34 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:35 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c 1073741824" returned: 0 in 1.426s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:36 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c Jul 03 16:18:36 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:37 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c" returned: 0 in 1.299s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] <== create_volume: return (2813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:18:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.817s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d49315f-0275-4d28-a5be-af3d48f355b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a29e3a9-edd3-40b7-a107-03a2d658889c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b1e2e6-f399-478d-a717-936c4ee2ef59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Volume volume-1a29e3a9-edd3-40b7-a107-03a2d658889c (1a29e3a9-edd3-40b7-a107-03a2d658889c): created successfully Jul 03 16:18:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b1e2e6-f399-478d-a717-936c4ee2ef59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Flow 'volume_create_manager' (3d97fada-aae9-4b24-952d-d983bcf1442f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:18:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-28893f1b-fc76-4ba3-bb9c-f507ca609fa5 tempest-GroupsTest-586163653 None] Created volume successfully. Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=57,cinder:DELETE=7,cinder:SELECT=49,cinder:INSERT=14 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Flow 'volume_create_manager' (16b410ff-b33e-4098-8bce-923d939f8c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6540f484-1b2b-4628-b929-387ecd025d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6540f484-1b2b-4628-b929-387ecd025d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1761766858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce528ec-3650-4c35-925d-f151aea521ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bd8ce2a8d04b84a857d830ca5fd427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:18:39Z,use_quota=True,user_id='a92f704ddb5a4463be4d67c7ed38b87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c673225-64e7-46ef-93f4-722d120ec094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c673225-64e7-46ef-93f4-722d120ec094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb0d951-78eb-4b66-99df-112c458e1694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb0d951-78eb-4b66-99df-112c458e1694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce528ec-3650-4c35-925d-f151aea521ae', 'volume_name': 'volume-8ce528ec-3650-4c35-925d-f151aea521ae', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ddb579-73a6-44e2-9987-075547294afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ddb579-73a6-44e2-9987-075547294afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce90e3c3-2496-425a-80ff-43153993ee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Volume 8ce528ec-3650-4c35-925d-f151aea521ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce528ec-3650-4c35-925d-f151aea521ae', 'volume_size': 1} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1761766858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce528ec-3650-4c35-925d-f151aea521ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39bd8ce2a8d04b84a857d830ca5fd427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:18:39Z,use_quota=True,user_id='a92f704ddb5a4463be4d67c7ed38b87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Creating volume 8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:18:39 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:39 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae 1073741824 Jul 03 16:18:39 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Flow 'volume_create_manager' (0b64f7c3-c612-4742-afb6-902cf5087f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e647d5b1-23a8-401c-8d12-94d3a1730a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e647d5b1-23a8-401c-8d12-94d3a1730a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1609363189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=621cc5b1-46c1-417f-9ece-8255a6322dca,host='devstack@QuobyteHD#QuobyteHD',id=e941bd2b-fa56-4081-b945-38c989ea3bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3aaec8c05534bf9b6069310831f4466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:18:40Z,use_quota=True,user_id='be485c687d8a41cb837146f6f611cb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(582534d4-f877-4090-a8ab-3b423f70a5ae),volume_type_id=582534d4-f877-4090-a8ab-3b423f70a5ae)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90dcaa6-8cbb-4308-b910-ea56954d650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90dcaa6-8cbb-4308-b910-ea56954d650a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4706ec06-97b4-4962-b7a9-2b3b74e7958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4706ec06-97b4-4962-b7a9-2b3b74e7958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e941bd2b-fa56-4081-b945-38c989ea3bdf', 'volume_name': 'volume-e941bd2b-fa56-4081-b945-38c989ea3bdf', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0794a832-d283-4149-a9d0-48e4b15112c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0794a832-d283-4149-a9d0-48e4b15112c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44352ec4-2b89-4ff7-9d82-b79f7c25b0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:39 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Volume e941bd2b-fa56-4081-b945-38c989ea3bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e941bd2b-fa56-4081-b945-38c989ea3bdf', 'volume_size': 1} Jul 03 16:18:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:40 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae 1073741824" returned: 0 in 1.230s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:40 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae Jul 03 16:18:40 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:41 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae" returned: 0 in 0.810s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.531s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=621cc5b1-46c1-417f-9ece-8255a6322dca,created_at=2026-07-03T14:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1609363189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=621cc5b1-46c1-417f-9ece-8255a6322dca,host='devstack@QuobyteHD#QuobyteHD',id=e941bd2b-fa56-4081-b945-38c989ea3bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3aaec8c05534bf9b6069310831f4466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:18:40Z,use_quota=True,user_id='be485c687d8a41cb837146f6f611cb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(582534d4-f877-4090-a8ab-3b423f70a5ae),volume_type_id=582534d4-f877-4090-a8ab-3b423f70a5ae)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Creating volume e941bd2b-fa56-4081-b945-38c989ea3bdf {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:18:41 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce90e3c3-2496-425a-80ff-43153993ee5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce528ec-3650-4c35-925d-f151aea521ae', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a470cec5-7753-4ccd-a936-e55bbb40536b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:41 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf 1073741824 Jul 03 16:18:41 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:41 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Volume volume-8ce528ec-3650-4c35-925d-f151aea521ae (8ce528ec-3650-4c35-925d-f151aea521ae): created successfully Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a470cec5-7753-4ccd-a936-e55bbb40536b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Flow 'volume_create_manager' (16b410ff-b33e-4098-8bce-923d939f8c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:18:41 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7d33b0ec-11dd-4f02-996e-fb70246e3d2c tempest-VolumesActionsTest-582600344 None] Created volume successfully. Jul 03 16:18:42 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf 1073741824" returned: 0 in 1.238s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:42 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf Jul 03 16:18:42 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:43 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf" returned: 0 in 1.233s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] <== create_volume: return (2529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:18:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.533s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44352ec4-2b89-4ff7-9d82-b79f7c25b0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e941bd2b-fa56-4081-b945-38c989ea3bdf', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc01efff-0c5c-49f6-b276-40ac2b770e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:18:44 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Volume volume-e941bd2b-fa56-4081-b945-38c989ea3bdf (e941bd2b-fa56-4081-b945-38c989ea3bdf): created successfully Jul 03 16:18:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc01efff-0c5c-49f6-b276-40ac2b770e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:18:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Flow 'volume_create_manager' (0b64f7c3-c612-4742-afb6-902cf5087f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:18:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-dd12200a-254a-44fa-b479-470eaa7b3060 tempest-GroupsTest-586163653 None] Created volume successfully. Jul 03 16:18:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ae02815d-411f-4a11-9530-72df4fa96659 tempest-GroupsTest-586163653 None] Update group completed successfully. Jul 03 16:18:46 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f6e17a78-a651-4c9f-aeab-db676d9984f1 tempest-GroupsTest-586163653 None] Update group completed successfully. Jul 03 16:18:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Acquiring lock "cinder-quobyte-1a29e3a9-edd3-40b7-a107-03a2d658889c" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:18:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Lock "cinder-quobyte-1a29e3a9-edd3-40b7-a107-03a2d658889c" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:18:48 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4059115a-c9c9-4b08-a9f9-9760546e882a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:18:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:48 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c Jul 03 16:18:48 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:49 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c" returned: 0 in 1.007s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:49 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c Jul 03 16:18:49 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:50 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1a29e3a9-edd3-40b7-a107-03a2d658889c" returned: 0 in 1.014s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Lock "cinder-quobyte-1a29e3a9-edd3-40b7-a107-03a2d658889c" released by "delete_volume" :: held 2.102s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:18:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Acquiring lock "cinder-quobyte-e941bd2b-fa56-4081-b945-38c989ea3bdf" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:18:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Lock "cinder-quobyte-e941bd2b-fa56-4081-b945-38c989ea3bdf" acquired by "delete_volume" :: waited 0.030s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:18:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cbfd6d-c2a8-447c-9c76-ee2546e12043]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:18:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:51 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf Jul 03 16:18:51 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:52 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf" returned: 0 in 1.370s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:52 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf Jul 03 16:18:52 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:53 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e941bd2b-fa56-4081-b945-38c989ea3bdf" returned: 0 in 0.937s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Lock "cinder-quobyte-e941bd2b-fa56-4081-b945-38c989ea3bdf" released by "delete_volume" :: held 2.398s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Created reservations ['3eb6cc89-2894-4391-8966-37c76c14c6bc'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:18:53 devstack cinder-volume[86659]: WARNING cinder.quota [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-850045358 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-850045358, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:18:53 devstack cinder-volume[86659]: WARNING cinder.quota [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-850045358 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-850045358, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Created reservations ['110ebbc8-56d9-4257-97f3-385184a71688', 'e13b537e-a26d-4b6c-9441-b0b95655ee01', '84caa5e4-7124-4f83-8338-830c291d8aa8', '4a439457-f692-4d2a-bee6-2a49e9b9e5ef'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Created reservations ['98df7f71-6560-4e16-bcc1-1dde2086600e', '0f40734f-aacc-4033-b584-75bea61f92ad', '7135a723-f26f-4fec-92e0-199a344748e1', '6873584f-1b10-4962-bc1d-b55752e42463'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:18:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:18:53 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:18:53 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:18:54 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 03 16:18:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.743s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:18:54 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:18:54 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2fba9724-855b-44c5-8676-d790f2230f83 tempest-GroupsTest-586163653 None] Delete group completed successfully. Jul 03 16:19:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1d984e27-34ec-48f8-ad83-97fc8aee89cd tempest-VolumesActionsTest-582600344 None] Acquiring lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae" by "attach_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1d984e27-34ec-48f8-ad83-97fc8aee89cd tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae" acquired by "attach_volume" :: waited 0.040s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:02 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1d984e27-34ec-48f8-ad83-97fc8aee89cd tempest-VolumesActionsTest-582600344 None] Attaching volume 8ce528ec-3650-4c35-925d-f151aea521ae to instance bb53c917-f3ce-4a0c-b175-f58921941305 at mountpoint /dev/vdb on host None. Jul 03 16:19:02 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1d984e27-34ec-48f8-ad83-97fc8aee89cd tempest-VolumesActionsTest-582600344 None] Attach volume completed successfully. Jul 03 16:19:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1d984e27-34ec-48f8-ad83-97fc8aee89cd tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae" released by "attach_volume" :: held 0.205s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c6dfcaec-8e3f-43a3-ba4f-548fe93b9478 tempest-VolumesActionsTest-582600344 None] Acquiring lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae-detach_volume" by "detach_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c6dfcaec-8e3f-43a3-ba4f-548fe93b9478 tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c6dfcaec-8e3f-43a3-ba4f-548fe93b9478 tempest-VolumesActionsTest-582600344 None] Detaching volume 8ce528ec-3650-4c35-925d-f151aea521ae from instance bb53c917-f3ce-4a0c-b175-f58921941305. Jul 03 16:19:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c6dfcaec-8e3f-43a3-ba4f-548fe93b9478 tempest-VolumesActionsTest-582600344 None] Detach volume completed successfully. Jul 03 16:19:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c6dfcaec-8e3f-43a3-ba4f-548fe93b9478 tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Acquiring lock "cinder-4c164ff2-b26c-49f7-9a8d-9d18201c9567-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "cinder-4c164ff2-b26c-49f7-9a8d-9d18201c9567-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Acquiring lock "cinder-quobyte-4c164ff2-b26c-49f7-9a8d-9d18201c9567" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "cinder-quobyte-4c164ff2-b26c-49f7-9a8d-9d18201c9567" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:06 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc00b58-daf2-4c6f-b1a5-b99baa9106b9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:06 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 Jul 03 16:19:06 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:07 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567" returned: 0 in 1.015s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:07 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567 Jul 03 16:19:07 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:08 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c164ff2-b26c-49f7-9a8d-9d18201c9567" returned: 0 in 0.791s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "cinder-quobyte-4c164ff2-b26c-49f7-9a8d-9d18201c9567" released by "delete_volume" :: held 1.891s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:08 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Created reservations ['4e9b94f0-1724-49c6-9f53-a7a0d5c72903', 'f27db2c8-bb1d-459b-8870-503a094bb913', '402ec36f-8cd5-4e8b-a2d6-aeceaf2f71ec', 'f58bc126-cb26-48ec-bb9d-781b8d04108c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:19:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:19:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:19:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:08 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:19:08 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:09 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.935s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:09 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:19:09 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Deleted volume successfully. Jul 03 16:19:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-68fb310b-f19c-4dee-8eab-f87a4536b305 tempest-AttachVolumeShelveTestJSON-100876405 None] Lock "cinder-4c164ff2-b26c-49f7-9a8d-9d18201c9567-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:15 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=59,cinder:INSERT=13,cinder:UPDATE=74,cinder:DELETE=2 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:19:15 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:19:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Flow 'volume_create_manager' (79f6633d-3284-4b98-80fd-26d7a81f012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:19:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a21758-c627-43cd-9e20-5383937da2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a21758-c627-43cd-9e20-5383937da2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2026674421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2489ead-2d54-43e8-a879-6285a97471ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d2950ad4874276ac158115db350372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:19:16Z,use_quota=True,user_id='aad1da7a6d0e4b1099f0103dbadf9285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d49a71c-36d3-42fd-9bb9-a3f278546494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d49a71c-36d3-42fd-9bb9-a3f278546494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba246e6-fd92-488d-9f01-72321a4f6a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba246e6-fd92-488d-9f01-72321a4f6a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2489ead-2d54-43e8-a879-6285a97471ec', 'volume_name': 'volume-d2489ead-2d54-43e8-a879-6285a97471ec', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bdd01a-13c6-4839-8548-ce894d350639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bdd01a-13c6-4839-8548-ce894d350639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be76e33d-2a01-4883-890f-b8202fc0a45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:16 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Volume d2489ead-2d54-43e8-a879-6285a97471ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2489ead-2d54-43e8-a879-6285a97471ec', 'volume_size': 1} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2026674421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2489ead-2d54-43e8-a879-6285a97471ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d2950ad4874276ac158115db350372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:19:16Z,use_quota=True,user_id='aad1da7a6d0e4b1099f0103dbadf9285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Creating volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:19:16 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:19:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:16 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec 1073741824 Jul 03 16:19:16 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:17 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec 1073741824" returned: 0 in 1.490s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:17 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec Jul 03 16:19:17 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:18 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec" returned: 0 in 0.890s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] <== create_volume: return (2464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be76e33d-2a01-4883-890f-b8202fc0a45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2489ead-2d54-43e8-a879-6285a97471ec', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea80b469-8a7c-485d-9573-b1ab1f538f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Volume volume-d2489ead-2d54-43e8-a879-6285a97471ec (d2489ead-2d54-43e8-a879-6285a97471ec): created successfully Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea80b469-8a7c-485d-9573-b1ab1f538f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Flow 'volume_create_manager' (79f6633d-3284-4b98-80fd-26d7a81f012b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:19:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c5fa2342-6f6e-4360-83be-023019988ef2 tempest-SnapshotsActionsTest-889858646 None] Created volume successfully. Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:18 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:19:18 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Creating offline snapshot e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:19:19 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd71a4-41b6-41a4-a447-2c7a4d6a9d26]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:19 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec Jul 03 16:19:19 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:20 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.331s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:19:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:19:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 8 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:19:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:19:20 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-66493194-7b38-4249-b4c5-a99c53989425 tempest-GroupSnapshotsTest-922618317 None] Group tempest-GroupSnapshotsTest-Group-1787620691: creating Jul 03 16:19:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-66493194-7b38-4249-b4c5-a99c53989425 tempest-GroupSnapshotsTest-922618317 None] Group tempest-GroupSnapshotsTest-Group-1787620691: created successfully Jul 03 16:19:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-66493194-7b38-4249-b4c5-a99c53989425 tempest-GroupSnapshotsTest-922618317 None] Create group completed successfully. Jul 03 16:19:21 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec" returned: 0 in 1.459s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:21 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 1G Jul 03 16:19:21 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:22 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 1G" returned: 0 in 1.341s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:22 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:19:22 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Flow 'volume_create_manager' (fb712457-3ad9-407b-8d8a-259032bb1119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2a836f-d39a-49a8-979f-b4d56d5e8c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2a836f-d39a-49a8-979f-b4d56d5e8c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1011068075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b8a480c-8bcc-4d46-bc73-ab2b5164e7a8,host='devstack@QuobyteHD#QuobyteHD',id=60f758f0-53cc-4904-8d86-387e7a38e02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593bd8d9603a45589c26eadb65c758ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:19:23Z,use_quota=True,user_id='d8b8c2c932764807b4a1da0ae452a0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29d11d1d-8f54-4728-a47c-86dbfcac4572),volume_type_id=29d11d1d-8f54-4728-a47c-86dbfcac4572)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac7fd8-d816-41d8-b3cb-e4a5dc2a6db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac7fd8-d816-41d8-b3cb-e4a5dc2a6db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bee2ff-c83e-456b-9f84-54c428d3a343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bee2ff-c83e-456b-9f84-54c428d3a343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f758f0-53cc-4904-8d86-387e7a38e02d', 'volume_name': 'volume-60f758f0-53cc-4904-8d86-387e7a38e02d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0df36b7-6532-427b-bad9-16c0993ce5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0df36b7-6532-427b-bad9-16c0993ce5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ce3e32-7967-4a1e-b40a-264700860055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:23 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Volume 60f758f0-53cc-4904-8d86-387e7a38e02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f758f0-53cc-4904-8d86-387e7a38e02d', 'volume_size': 1} Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:23 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 1.185s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:23 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 is being set with open permissions: ugo+rw Jul 03 16:19:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:23 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:19:23 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:24 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 0.815s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:24 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.info Jul 03 16:19:24 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:25 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.info" returned: 0 in 0.717s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:25 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.info is being set with open permissions: ugo+rw Jul 03 16:19:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:25 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.info Jul 03 16:19:25 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:26 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.info" returned: 0 in 0.789s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.436s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.872s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4b8a480c-8bcc-4d46-bc73-ab2b5164e7a8,created_at=2026-07-03T14:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1011068075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b8a480c-8bcc-4d46-bc73-ab2b5164e7a8,host='devstack@QuobyteHD#QuobyteHD',id=60f758f0-53cc-4904-8d86-387e7a38e02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593bd8d9603a45589c26eadb65c758ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:19:23Z,use_quota=True,user_id='d8b8c2c932764807b4a1da0ae452a0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29d11d1d-8f54-4728-a47c-86dbfcac4572),volume_type_id=29d11d1d-8f54-4728-a47c-86dbfcac4572)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Creating volume 60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:19:26 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:19:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:26 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d 1073741824 Jul 03 16:19:26 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:26 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ac160767-3e69-48fc-b129-66fe867f26ee tempest-SnapshotsActionsTest-889858646 None] Create snapshot completed successfully Jul 03 16:19:27 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d 1073741824" returned: 0 in 1.021s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:27 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d Jul 03 16:19:27 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:28 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d" returned: 0 in 0.928s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ce3e32-7967-4a1e-b40a-264700860055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f758f0-53cc-4904-8d86-387e7a38e02d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f53342-538f-49ef-a2a9-45e91b0b58f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Creating offline snapshot c49ab3e9-351f-400f-97db-2f3e39b853c5 of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:19:28 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Volume volume-60f758f0-53cc-4904-8d86-387e7a38e02d (60f758f0-53cc-4904-8d86-387e7a38e02d): created successfully Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f53342-538f-49ef-a2a9-45e91b0b58f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Flow 'volume_create_manager' (fb712457-3ad9-407b-8d8a-259032bb1119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d6af26-c9dc-4c95-b3f9-f836732f1395]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3f082a5b-6ef5-4948-9282-5559657f7e13 tempest-GroupSnapshotsTest-922618317 None] Created volume successfully. Jul 03 16:19:28 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:19:28 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:29 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 1.191s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:19:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:29 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 1G Jul 03 16:19:29 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] GroupSnapshot 2aaa9d02-6841-45a3-8a56-44eec29f617f: creating. Jul 03 16:19:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Group snapshot 2aaa9d02-6841-45a3-8a56-44eec29f617f: creating. {{(pid=86659) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 16:19:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:30 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 1G" returned: 0 in 1.118s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:30 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 Jul 03 16:19:30 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:31 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5" returned: 0 in 0.869s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:31 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 is being set with open permissions: ugo+rw Jul 03 16:19:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:31 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 Jul 03 16:19:31 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:32 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5" returned: 0 in 0.722s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.041s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.480s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Creating offline snapshot b41ad0c4-3e11-4134-8dad-f95c563735f3 of volume 60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:19:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fb53bbbd-a0e5-46ee-a8e8-da8fbadc4def tempest-SnapshotsActionsTest-889858646 None] Create snapshot completed successfully Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[48836b5e-82b3-49ac-81e9-aed350bcf53e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:32 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d Jul 03 16:19:32 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-c49ab3e9-351f-400f-97db-2f3e39b853c5-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-c49ab3e9-351f-400f-97db-2f3e39b853c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-quobyte-c49ab3e9-351f-400f-97db-2f3e39b853c5" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-c49ab3e9-351f-400f-97db-2f3e39b853c5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Deleting offline snapshot c49ab3e9-351f-400f-97db-2f3e39b853c5 of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] snapshot_file for this snap is: volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-246bac49-e056-44b8-8787-dad887c06a07 tempest-VolumesActionsTest-582600344 None] Acquiring lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae" by "attach_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[92896363-06b6-447a-bf90-74af926af372]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-246bac49-e056-44b8-8787-dad887c06a07 tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae" acquired by "attach_volume" :: waited 0.056s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-246bac49-e056-44b8-8787-dad887c06a07 tempest-VolumesActionsTest-582600344 None] Attaching volume 8ce528ec-3650-4c35-925d-f151aea521ae to instance f9faa64d-25cb-4b0e-92e3-6b937c1f7f18 at mountpoint /dev/vdb on host None. Jul 03 16:19:33 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 Jul 03 16:19:33 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-246bac49-e056-44b8-8787-dad887c06a07 tempest-VolumesActionsTest-582600344 None] Attach volume completed successfully. Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-246bac49-e056-44b8-8787-dad887c06a07 tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae" released by "attach_volume" :: held 0.205s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b273145d-cb68-47e1-956e-bc5db4d8b56a tempest-VolumesActionsTest-582600344 None] Acquiring lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae-detach_volume" by "detach_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:33 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b273145d-cb68-47e1-956e-bc5db4d8b56a tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b273145d-cb68-47e1-956e-bc5db4d8b56a tempest-VolumesActionsTest-582600344 None] Detaching volume 8ce528ec-3650-4c35-925d-f151aea521ae from instance f9faa64d-25cb-4b0e-92e3-6b937c1f7f18. Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d" returned: 0 in 1.430s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:33 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 1G Jul 03 16:19:33 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b273145d-cb68-47e1-956e-bc5db4d8b56a tempest-VolumesActionsTest-582600344 None] Detach volume completed successfully. Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b273145d-cb68-47e1-956e-bc5db4d8b56a tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:33 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5" returned: 0 in 1.132s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dcc2e5-79c5-49c0-b5b7-c29afbe6c5cc]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:34 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:19:34 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:34 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 1G" returned: 0 in 1.299s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f758f0-53cc-4904-8d86-387e7a38e02d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:35 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f758f0-53cc-4904-8d86-387e7a38e02d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 Jul 03 16:19:35 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:35 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 1.056s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:19:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:35 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 Jul 03 16:19:35 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:35 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f758f0-53cc-4904-8d86-387e7a38e02d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3" returned: 0 in 0.982s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:35 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:19:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:35 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 Jul 03 16:19:35 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:36 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5" returned: 0 in 1.153s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:36 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5 Jul 03 16:19:36 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:36 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3" returned: 0 in 0.827s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:36 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.info Jul 03 16:19:36 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:36 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.c49ab3e9-351f-400f-97db-2f3e39b853c5" returned: 0 in 0.746s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-c49ab3e9-351f-400f-97db-2f3e39b853c5" released by "_delete_snapshot" :: held 4.250s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" released by "delete_snapshot" :: held 4.298s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:37 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Created reservations ['414c3334-238f-4ec3-b79e-6021940a0750', '130914d9-ab98-4e93-92fe-e52d3333e508', '29431dad-c06d-425b-9882-ce91dbecd260', 'a3fc7200-602a-41a5-bcce-a99accb2088c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:19:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Delete snapshot completed successfully. Jul 03 16:19:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2dd9c3b-95b8-4542-ae83-4dee5750c8e1 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-c49ab3e9-351f-400f-97db-2f3e39b853c5-delete_snapshot" released by "delete_snapshot" :: held 4.524s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:37 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.info" returned: 0 in 0.977s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:37 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:19:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:37 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.info Jul 03 16:19:37 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Flow 'volume_create_manager' (fdd1bd5b-c5c3-44e0-8a80-b24665b7995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed7da01-abe6-4bfe-b11f-68d53858788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed7da01-abe6-4bfe-b11f-68d53858788e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1784090456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64dd718-97d6-4ed1-90c7-3a380cd0863d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692b2a15a294402b075e614292d1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:19:38Z,use_quota=True,user_id='1e4ae87af9a54a388fe862a5bdc7b4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529c39f7-5cd0-4431-9d90-620e4c48f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529c39f7-5cd0-4431-9d90-620e4c48f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118283ba-17d7-4f93-b274-e2d5a23f8ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118283ba-17d7-4f93-b274-e2d5a23f8ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64dd718-97d6-4ed1-90c7-3a380cd0863d', 'volume_name': 'volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421724f3-2891-414e-82e8-779ada83815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421724f3-2891-414e-82e8-779ada83815d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9593fbdd-eab0-4d3b-9dbf-1bd51a5616e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Volume b64dd718-97d6-4ed1-90c7-3a380cd0863d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d', 'volume_size': 1} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:38 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.info" returned: 0 in 0.716s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.347s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1784090456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64dd718-97d6-4ed1-90c7-3a380cd0863d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692b2a15a294402b075e614292d1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:19:38Z,use_quota=True,user_id='1e4ae87af9a54a388fe862a5bdc7b4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Creating volume b64dd718-97d6-4ed1-90c7-3a380cd0863d {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:19:38 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:19:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:38 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d 1073741824 Jul 03 16:19:38 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-14809447-545c-4cc9-a38d-cff127cb4a6e tempest-GroupSnapshotsTest-922618317 None] group_snapshot 2aaa9d02-6841-45a3-8a56-44eec29f617f: created successfully Jul 03 16:19:39 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d 1073741824" returned: 0 in 0.991s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:39 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=58,cinder:INSERT=18,cinder:UPDATE=55,cinder:DELETE=3 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:19:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:39 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d Jul 03 16:19:39 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:40 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d" returned: 0 in 0.746s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.901s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9593fbdd-eab0-4d3b-9dbf-1bd51a5616e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a0f067-0de8-4355-a94b-e48d1feb1239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Creating offline snapshot 0a87b4dd-dbb0-459b-b022-9303fd7304f5 of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:19:40 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Volume volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d (b64dd718-97d6-4ed1-90c7-3a380cd0863d): created successfully Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a0f067-0de8-4355-a94b-e48d1feb1239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Flow 'volume_create_manager' (fdd1bd5b-c5c3-44e0-8a80-b24665b7995a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04dde6f-bf7f-47ee-9582-f47832c55f48]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:40 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4421148b-5e7b-4c06-8593-84ca938d3c91 tempest-AttachVolumeNegativeTest-2091901602 None] Created volume successfully. Jul 03 16:19:40 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:19:40 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:41 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 0.874s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:19:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:41 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 1G Jul 03 16:19:41 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:42 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 1G" returned: 0 in 0.894s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:42 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 Jul 03 16:19:42 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:42 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5" returned: 0 in 0.774s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:42 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 is being set with open permissions: ugo+rw Jul 03 16:19:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:43 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 Jul 03 16:19:43 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:43 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5" returned: 0 in 0.704s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.413s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.088s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-b41ad0c4-3e11-4134-8dad-f95c563735f3-fc94b21c-e70d-4138-8fc7-746f813fa0f6" by "_create_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-b41ad0c4-3e11-4134-8dad-f95c563735f3-fc94b21c-e70d-4138-8fc7-746f813fa0f6" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Creating volume fc94b21c-e70d-4138-8fc7-746f813fa0f6 from snapshot b41ad0c4-3e11-4134-8dad-f95c563735f3 {{(pid=86659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-fc94b21c-e70d-4138-8fc7-746f813fa0f6" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-fc94b21c-e70d-4138-8fc7-746f813fa0f6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] snapshot: b41ad0c4-3e11-4134-8dad-f95c563735f3, volume: fc94b21c-e70d-4138-8fc7-746f813fa0f6, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:43 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-be2f0aa5-1a11-4338-b92d-29e578bdb37d tempest-SnapshotsActionsTest-889858646 None] Create snapshot completed successfully Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e845a91-7dc5-42b0-940c-3fdf646250ae]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:43 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 Jul 03 16:19:43 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-e268d5f3-d448-48e3-81ee-345779ff85e0 req-034ad364-3600-4977-a3f3-3eb21b918ab3 tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:44 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3" returned: 0 in 0.795s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60f758f0-53cc-4904-8d86-387e7a38e02d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9acfaf-8b80-410a-96cd-e998dcaac0aa]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:44 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d Jul 03 16:19:44 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-0a87b4dd-dbb0-459b-b022-9303fd7304f5-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-0a87b4dd-dbb0-459b-b022-9303fd7304f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-quobyte-0a87b4dd-dbb0-459b-b022-9303fd7304f5" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-0a87b4dd-dbb0-459b-b022-9303fd7304f5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Deleting offline snapshot 0a87b4dd-dbb0-459b-b022-9303fd7304f5 of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] snapshot_file for this snap is: volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb94191-3130-4054-955c-2650662f8e67]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:45 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 Jul 03 16:19:45 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:45 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d" returned: 0 in 0.821s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:45 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:19:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:45 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 Jul 03 16:19:45 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:45 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5" returned: 0 in 0.846s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:19:45 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5f10e6-8743-43ac-859d-3cf8b68f5d7d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:45 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:19:45 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:46 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 0.949s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:19:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:46 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 Jul 03 16:19:46 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:48 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5" returned: 0 in 2.085s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:48 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5 Jul 03 16:19:48 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:50 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.0a87b4dd-dbb0-459b-b022-9303fd7304f5" returned: 0 in 1.525s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-0a87b4dd-dbb0-459b-b022-9303fd7304f5" released by "_delete_snapshot" :: held 5.535s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" released by "delete_snapshot" :: held 5.568s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:50 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Created reservations ['3f466078-fe4a-41ea-b7ef-09d252f21f5f', '53857247-610a-4ca1-aec2-bc97c41a3dcc', '009e5524-94c7-4e2d-9119-c686d046f1e8', '94c8c447-f25c-4cee-9349-27000e025bb8'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:19:50 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Delete snapshot completed successfully. Jul 03 16:19:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-036a8070-c91e-40a9-ace3-6d338382267f tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-0a87b4dd-dbb0-459b-b022-9303fd7304f5-delete_snapshot" released by "delete_snapshot" :: held 5.932s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:50 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6" returned: 0 in 5.409s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d626072e-d59e-40bf-80f4-b8f1c512ca61]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:51 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d Jul 03 16:19:51 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:51 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d" returned: 0 in 0.951s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:51 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:19:51 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Converted 1024.00 MB image at 189.29 MB/s Jul 03 16:19:51 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:19:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:51 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 Jul 03 16:19:51 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:52 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6" returned: 0 in 0.676s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-fc94b21c-e70d-4138-8fc7-746f813fa0f6" released by "_copy_volume_from_snapshot" :: held 8.758s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-b41ad0c4-3e11-4134-8dad-f95c563735f3-fc94b21c-e70d-4138-8fc7-746f813fa0f6" released by "_create_volume_from_snapshot" :: held 8.797s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.827s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.294s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bb0c3d-c4a3-4589-af16-463fbd807958]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:52 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-025be829-c948-4bbf-85b1-f56cc86ace4a tempest-GroupSnapshotsTest-922618317 None] Create group from source-snapshot-2aaa9d02-6841-45a3-8a56-44eec29f617f completed successfully. Jul 03 16:19:52 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae Jul 03 16:19:52 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:53 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae" returned: 0 in 0.766s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[667d129f-7a01-4c32-aa01-d95786021064]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:53 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae Jul 03 16:19:53 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-fc94b21c-e70d-4138-8fc7-746f813fa0f6" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-fc94b21c-e70d-4138-8fc7-746f813fa0f6" acquired by "delete_volume" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f27ecd-f6a0-42a6-a997-2df735aa4671]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:54 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 Jul 03 16:19:54 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:54 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae" returned: 0 in 0.817s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.bfd85971-783b-4aec-8c88-778ffa9ea791_8l2cvzc.img {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:54 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.bfd85971-783b-4aec-8c88-778ffa9ea791_8l2cvzc.img Jul 03 16:19:54 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:54 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6" returned: 0 in 0.836s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:54 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6 Jul 03 16:19:54 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:55 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc94b21c-e70d-4138-8fc7-746f813fa0f6" returned: 0 in 1.094s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-fc94b21c-e70d-4138-8fc7-746f813fa0f6" released by "delete_volume" :: held 1.988s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Created reservations ['aa35d95d-e74d-462b-902f-76de5b5f300c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:19:56 devstack cinder-volume[86659]: WARNING cinder.quota [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-176135696 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-176135696, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:19:56 devstack cinder-volume[86659]: WARNING cinder.quota [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-176135696 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-176135696, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Created reservations ['93c27303-6d80-46a9-9602-a05dcb7c9bc6', 'db29124e-47fc-4721-a7ec-97cc15c14171', '3ea9dd8b-0303-4bf0-a033-54e82747e764', 'c77d03ef-b9e0-481e-a7ee-6c89e779ddc2'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:56 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:19:56 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:56 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] group_snapshot 2aaa9d02-6841-45a3-8a56-44eec29f617f: deleting Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] group_snapshot 2aaa9d02-6841-45a3-8a56-44eec29f617f: deleting {{(pid=86659) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-60f758f0-53cc-4904-8d86-387e7a38e02d" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-60f758f0-53cc-4904-8d86-387e7a38e02d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-b41ad0c4-3e11-4134-8dad-f95c563735f3" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-b41ad0c4-3e11-4134-8dad-f95c563735f3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Deleting offline snapshot b41ad0c4-3e11-4134-8dad-f95c563735f3 of volume 60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:19:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] snapshot_file for this snap is: volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:19:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e7cd8-0e2e-4c16-96d8-3904404ec544]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:57 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.029s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:57 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:19:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-8434aff3-ae5d-49d9-a65c-fdcdccb6bb82 tempest-GroupSnapshotsTest-922618317 None] Delete group completed successfully. Jul 03 16:19:57 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 Jul 03 16:19:57 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:59 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3" returned: 0 in 1.967s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60f758f0-53cc-4904-8d86-387e7a38e02d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:19:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4137b8f-bba5-456b-a46c-11bc5995a70a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:19:59 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d Jul 03 16:19:59 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:19:59 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Jul 03 16:19:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.bfd85971-783b-4aec-8c88-778ffa9ea791_8l2cvzc.img" returned: 0 in 5.738s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:19:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fe83a0-52ad-4b71-a76b-d99d21986db0]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:19:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:00 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae Jul 03 16:20:00 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:00 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d" returned: 0 in 1.216s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:00 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 Jul 03 16:20:00 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:00 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae" returned: 0 in 1.005s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:00 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.bfd85971-783b-4aec-8c88-778ffa9ea791_8l2cvzc.img {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:20:00 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Converted 1024.00 MB image at 178.42 MB/s Jul 03 16:20:00 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] bfd85971-783b-4aec-8c88-778ffa9ea791 was raw, no need to convert to raw {{(pid=86659) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 03 16:20:01 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3" returned: 0 in 0.824s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:01 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3 Jul 03 16:20:01 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:01 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d.b41ad0c4-3e11-4134-8dad-f95c563735f3" returned: 0 in 0.759s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-b41ad0c4-3e11-4134-8dad-f95c563735f3" released by "_delete_snapshot" :: held 5.088s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-60f758f0-53cc-4904-8d86-387e7a38e02d" released by "delete_snapshot" :: held 5.128s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:02 devstack cinder-volume[86659]: WARNING cinder.quota [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-176135696 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-176135696, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:20:02 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] Created reservations ['4348a5a6-9fba-4ecb-bb3b-f62e11005111', 'b1e4c93b-c862-42fa-b09b-9c064e854934', '89082b22-60e0-469c-84f7-470e021928a1', 'c9d7e4f3-3d11-4889-8d72-4f28dafeac2f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:20:02 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-916643c0-2af6-43e2-ac89-f5f3373d7b2e tempest-GroupSnapshotsTest-922618317 None] group_snapshot 2aaa9d02-6841-45a3-8a56-44eec29f617f: deleted successfully Jul 03 16:20:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-60f758f0-53cc-4904-8d86-387e7a38e02d" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-60f758f0-53cc-4904-8d86-387e7a38e02d" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55c9d2-986a-40bb-a18b-fc72b7852182]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:03 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d Jul 03 16:20:03 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:04 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d" returned: 0 in 0.871s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:04 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d Jul 03 16:20:04 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:04 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-60f758f0-53cc-4904-8d86-387e7a38e02d" returned: 0 in 0.691s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-60f758f0-53cc-4904-8d86-387e7a38e02d" released by "delete_volume" :: held 1.646s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:04 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Created reservations ['9941e9dd-1a55-4194-a0d9-c3494546b54a'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:20:04 devstack cinder-volume[86659]: WARNING cinder.db.api [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-176135696'] Jul 03 16:20:04 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Created reservations ['ccd7da23-a718-4ec9-a735-3a33953233a2', '62592f9c-caf8-4b4f-8886-4b7ff00b6cde', '43be3858-3d7f-4716-9859-6b01178df621', '7a6ff631-d0af-4753-8d57-b6244fcb3066'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:20:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:20:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:20:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:05 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:20:05 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:05 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.731s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:05 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:20:05 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1eb1caab-d7b6-46db-8a47-e2a572ff6164 tempest-GroupSnapshotsTest-922618317 None] Delete group completed successfully. Jul 03 16:20:05 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0c2539bb-71bb-464f-b5cc-c830a64361c5 tempest-GroupSnapshotsTest-922618317 None] Group tempest-GroupSnapshotsTest-Group-1392719360: creating Jul 03 16:20:06 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0c2539bb-71bb-464f-b5cc-c830a64361c5 tempest-GroupSnapshotsTest-922618317 None] Group tempest-GroupSnapshotsTest-Group-1392719360: created successfully Jul 03 16:20:06 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0c2539bb-71bb-464f-b5cc-c830a64361c5 tempest-GroupSnapshotsTest-922618317 None] Create group completed successfully. Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Flow 'volume_create_manager' (98f83468-4807-4f61-9752-e509ff097c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69df2bba-6ba4-481d-b354-c43584e4c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69df2bba-6ba4-481d-b354-c43584e4c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392544828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2223cb40-d40b-4928-824a-f39bc293a213,host='devstack@QuobyteHD#QuobyteHD',id=224da1ca-a8c2-40d5-9048-1479b1bbeeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593bd8d9603a45589c26eadb65c758ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:20:08Z,use_quota=True,user_id='d8b8c2c932764807b4a1da0ae452a0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de264117-724a-43cc-9ffe-ae2b29588edf),volume_type_id=de264117-724a-43cc-9ffe-ae2b29588edf)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d12802-bc00-4a41-b246-a438c378f147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d12802-bc00-4a41-b246-a438c378f147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97233f84-c4fd-4f57-8584-9dc7f4ef3663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97233f84-c4fd-4f57-8584-9dc7f4ef3663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224da1ca-a8c2-40d5-9048-1479b1bbeeb3', 'volume_name': 'volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1cfa48-0634-4985-9aec-15560f8bc50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1cfa48-0634-4985-9aec-15560f8bc50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0f7dca-1254-4301-8139-cd9cbfccdc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:07 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Volume 224da1ca-a8c2-40d5-9048-1479b1bbeeb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3', 'volume_size': 1} Jul 03 16:20:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:17 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=74,cinder:UPDATE=57,cinder:DELETE=4,cinder:INSERT=14 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:20:17 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=42,cinder:SELECT=42,cinder:DELETE=1,cinder:INSERT=7 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:20:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:20:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:20:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:20:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:18 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:20:18 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:19 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.742s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:20:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:20:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:20:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:20:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.934s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Uploaded volume to glance image-id: bfd85971-783b-4aec-8c88-778ffa9ea791. {{(pid=86659) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 16:20:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-e268d5f3-d448-48e3-81ee-345779ff85e0 req-034ad364-3600-4977-a3f3-3eb21b918ab3 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 37.207s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:21 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5800265b-8f49-4194-8e35-bd214425c66d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-e268d5f3-d448-48e3-81ee-345779ff85e0 req-034ad364-3600-4977-a3f3-3eb21b918ab3 tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-41b0ddf7-4f9c-49ff-9ddc-51d0253f771b tempest-VolumesActionsTest-582600344 None] Copy volume to image completed successfully. Jul 03 16:20:21 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d Jul 03 16:20:21 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:22 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-e268d5f3-d448-48e3-81ee-345779ff85e0 req-034ad364-3600-4977-a3f3-3eb21b918ab3 tempest-AttachVolumeNegativeTest-2091901602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d" returned: 0 in 0.819s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-e268d5f3-d448-48e3-81ee-345779ff85e0 req-034ad364-3600-4977-a3f3-3eb21b918ab3 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 30.851s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Creating offline snapshot a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:20:22 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bb9a66-19e8-49a9-a61e-63c3d247b4da]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-e268d5f3-d448-48e3-81ee-345779ff85e0 req-034ad364-3600-4977-a3f3-3eb21b918ab3 tempest-AttachVolumeNegativeTest-2091901602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e9fff9d-a8ab-4a85-8c97-2cd91fe04d90', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:20:22 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-e268d5f3-d448-48e3-81ee-345779ff85e0 req-034ad364-3600-4977-a3f3-3eb21b918ab3 tempest-AttachVolumeNegativeTest-2091901602 None] attachment_update completed successfully. Jul 03 16:20:22 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:20:22 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:23 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 0.911s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:20:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:23 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed 1G Jul 03 16:20:23 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:24 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed 1G" returned: 0 in 0.936s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:24 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed Jul 03 16:20:24 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:25 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed" returned: 0 in 0.772s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:25 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed is being set with open permissions: ugo+rw Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:25 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed Jul 03 16:20:25 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:25 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed" returned: 0 in 0.645s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.381s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.916s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2223cb40-d40b-4928-824a-f39bc293a213,created_at=2026-07-03T14:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392544828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2223cb40-d40b-4928-824a-f39bc293a213,host='devstack@QuobyteHD#QuobyteHD',id=224da1ca-a8c2-40d5-9048-1479b1bbeeb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593bd8d9603a45589c26eadb65c758ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:20:08Z,use_quota=True,user_id='d8b8c2c932764807b4a1da0ae452a0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de264117-724a-43cc-9ffe-ae2b29588edf),volume_type_id=de264117-724a-43cc-9ffe-ae2b29588edf)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Creating volume 224da1ca-a8c2-40d5-9048-1479b1bbeeb3 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:20:25 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:20:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:25 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 1073741824 Jul 03 16:20:25 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a29f5a62-849a-4739-8722-c51f58b3cd0b tempest-SnapshotsActionsTest-889858646 None] Create snapshot completed successfully Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-quobyte-a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Deleting offline snapshot a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] snapshot_file for this snap is: volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f90f2a-5cac-4779-8fce-8ef1154a8b3f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:26 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed Jul 03 16:20:26 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:26 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 1073741824" returned: 0 in 0.995s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:26 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 Jul 03 16:20:26 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:27 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed" returned: 0 in 0.952s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7097a17-d41c-4baa-bd08-a84f9a585816]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:27 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:20:27 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:27 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" returned: 0 in 0.820s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.681s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0f7dca-1254-4301-8139-cd9cbfccdc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eabe7d1-3876-4f36-9c21-d4bba4718ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df7543-232b-497d-a9bb-cfddfffa58ef]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:27 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Volume volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 (224da1ca-a8c2-40d5-9048-1479b1bbeeb3): created successfully Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eabe7d1-3876-4f36-9c21-d4bba4718ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Flow 'volume_create_manager' (98f83468-4807-4f61-9752-e509ff097c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:20:27 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ec88ca45-6511-4e28-8d2c-17260f9a1f9e tempest-GroupSnapshotsTest-922618317 None] Created volume successfully. Jul 03 16:20:27 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae Jul 03 16:20:27 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:28 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 1.144s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:20:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:28 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed Jul 03 16:20:28 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae" returned: 0 in 1.042s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:28 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6c939-91af-4452-9855-16775b680b3c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:28 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae Jul 03 16:20:28 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:29 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae" returned: 0 in 0.912s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:29 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img Jul 03 16:20:29 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:29 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed" returned: 0 in 1.151s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:29 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed Jul 03 16:20:29 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Flow 'volume_create_manager' (9a4dbe05-41ee-423b-b036-aeaec95707ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d38e87f-0284-4da0-b579-d0a004c7c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d38e87f-0284-4da0-b579-d0a004c7c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-424018003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2223cb40-d40b-4928-824a-f39bc293a213,host='devstack@QuobyteHD#QuobyteHD',id=8574f45a-c361-4ca2-afc1-e80996d32d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593bd8d9603a45589c26eadb65c758ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:20:30Z,use_quota=True,user_id='d8b8c2c932764807b4a1da0ae452a0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de264117-724a-43cc-9ffe-ae2b29588edf),volume_type_id=de264117-724a-43cc-9ffe-ae2b29588edf)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d314988c-e469-4144-a3ff-90254ecdcd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d314988c-e469-4144-a3ff-90254ecdcd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c733be4b-6b8e-4db5-892a-0094c2f3b0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c733be4b-6b8e-4db5-892a-0094c2f3b0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8574f45a-c361-4ca2-afc1-e80996d32d4d', 'volume_name': 'volume-8574f45a-c361-4ca2-afc1-e80996d32d4d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3c84ea-5b2b-4a18-be18-791a44803e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3c84ea-5b2b-4a18-be18-791a44803e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d049024a-576a-4c8d-ad80-31478e5e841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:29 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Volume 8574f45a-c361-4ca2-afc1-e80996d32d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8574f45a-c361-4ca2-afc1-e80996d32d4d', 'volume_size': 1} Jul 03 16:20:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:30 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed" returned: 0 in 1.127s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed" released by "_delete_snapshot" :: held 4.555s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" released by "delete_snapshot" :: held 4.592s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:31 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Created reservations ['8e74cd85-a791-42e0-9bf7-1b2a506f495c', '7dbae048-8458-433e-b322-54b1cefad841', 'caffdadb-125f-4655-a120-c88b96187bc9', '36c4d964-195c-4464-8221-02c3b5de8f74'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:20:31 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Delete snapshot completed successfully. Jul 03 16:20:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01fd0065-9a6b-4147-8b06-d7085b895e29 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-a4ce9a2c-0fe3-4403-a5db-8bd8cef5c5ed-delete_snapshot" released by "delete_snapshot" :: held 4.825s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:35 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img" returned: 0 in 5.875s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:35 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c459be-51a1-4bfd-9cac-19c594eece21]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:35 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae Jul 03 16:20:35 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:36 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae" returned: 0 in 1.016s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:36 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:20:36 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Converted 1024.00 MB image at 174.27 MB/s Jul 03 16:20:36 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] 7708e43b-fb6e-46a2-8859-dec29ebe28fc was raw, converting to qcow2 {{(pid=86659) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 03 16:20:36 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[114d553c-e58c-44ce-9225-b854d9f4143b]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:36 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img Jul 03 16:20:36 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:37 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img" returned: 0 in 0.778s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:37 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img Jul 03 16:20:37 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:38 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img" returned: 1 in 0.784s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:20:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img /opt/stack/data/cinder/conversion/vol_upload_j4fukdwa {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:38 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img /opt/stack/data/cinder/conversion/vol_upload_j4fukdwa Jul 03 16:20:38 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:38 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img /opt/stack/data/cinder/conversion/vol_upload_j4fukdwa" returned: 0 in 0.718s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:38 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Image conversion details: src /opt/stack/data/cinder/conversion/8ce528ec-3650-4c35-925d-f151aea521ae.temp_image.7708e43b-fb6e-46a2-8859-dec29ebe28fcmuvf_8z0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_j4fukdwa {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:20:38 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 03 16:20:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4a0832-8ee0-4193-a01a-950e3b6eda1f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j4fukdwa {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:38 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j4fukdwa Jul 03 16:20:38 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:39 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j4fukdwa" returned: 0 in 0.883s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.867s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Uploaded volume to glance image-id: 7708e43b-fb6e-46a2-8859-dec29ebe28fc. {{(pid=86659) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.571s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2223cb40-d40b-4928-824a-f39bc293a213,created_at=2026-07-03T14:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-424018003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2223cb40-d40b-4928-824a-f39bc293a213,host='devstack@QuobyteHD#QuobyteHD',id=8574f45a-c361-4ca2-afc1-e80996d32d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593bd8d9603a45589c26eadb65c758ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:20:30Z,use_quota=True,user_id='d8b8c2c932764807b4a1da0ae452a0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de264117-724a-43cc-9ffe-ae2b29588edf),volume_type_id=de264117-724a-43cc-9ffe-ae2b29588edf)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Creating volume 8574f45a-c361-4ca2-afc1-e80996d32d4d {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:20:41 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:20:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:41 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d 1073741824 Jul 03 16:20:41 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:41 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6a847337-5e05-4666-bccd-7a8a89363d96 tempest-VolumesActionsTest-582600344 None] Copy volume to image completed successfully. Jul 03 16:20:42 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d 1073741824" returned: 0 in 0.947s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:42 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d Jul 03 16:20:42 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Acquiring lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Acquiring lock "cinder-quobyte-8ce528ec-3650-4c35-925d-f151aea521ae" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Lock "cinder-quobyte-8ce528ec-3650-4c35-925d-f151aea521ae" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:42 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[682c0326-5d5d-445c-a716-ea7a16259a74]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:42 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae Jul 03 16:20:42 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:43 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d" returned: 0 in 0.858s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.638s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d049024a-576a-4c8d-ad80-31478e5e841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8574f45a-c361-4ca2-afc1-e80996d32d4d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c75d80c-93e5-418d-856e-fc26df8f2db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Creating offline snapshot 980f7462-9fba-4995-addf-ac96d7828428 of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:20:43 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Volume volume-8574f45a-c361-4ca2-afc1-e80996d32d4d (8574f45a-c361-4ca2-afc1-e80996d32d4d): created successfully Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c75d80c-93e5-418d-856e-fc26df8f2db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Flow 'volume_create_manager' (9a4dbe05-41ee-423b-b036-aeaec95707ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a21993-b2ba-4711-bb73-74cc619463c2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:43 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-91b17262-6f37-47b2-8d73-2083b89f17d0 tempest-GroupSnapshotsTest-922618317 None] Created volume successfully. Jul 03 16:20:43 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:20:43 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:43 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae" returned: 0 in 0.905s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:43 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae Jul 03 16:20:43 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b363d821-890d-4152-af0f-b8ba8ebe6d6d tempest-GroupSnapshotsTest-922618317 None] Update group completed successfully. Jul 03 16:20:44 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 0.918s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:44 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 1G Jul 03 16:20:44 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:44 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8ce528ec-3650-4c35-925d-f151aea521ae" returned: 0 in 0.838s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Lock "cinder-quobyte-8ce528ec-3650-4c35-925d-f151aea521ae" released by "delete_volume" :: held 1.803s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Created reservations ['d87bce66-a14c-4a41-a997-83660ca4cbd9', '98b331bd-6308-49c5-b33a-2681f4c6be82', 'a200cf72-510c-4cc0-86f1-cd81593850e3', '7478ce3f-2699-4b3a-8bc7-4d41616b0916'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:44 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:20:44 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-48572724-78cd-4b3e-82dd-48af5827af24 tempest-GroupSnapshotsTest-922618317 None] Update group completed successfully. Jul 03 16:20:45 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 1G" returned: 0 in 1.069s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:45 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 Jul 03 16:20:45 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:45 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.822s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:45 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:20:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Deleted volume successfully. Jul 03 16:20:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d5b7a10-523f-47b3-a330-95a2eb72690a tempest-VolumesActionsTest-582600344 None] Lock "cinder-8ce528ec-3650-4c35-925d-f151aea521ae-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:46 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428" returned: 0 in 0.854s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:46 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 is being set with open permissions: ugo+rw Jul 03 16:20:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:46 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 Jul 03 16:20:46 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:46 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-27808156-d07a-476f-9407-7b4064c47f94 tempest-GroupSnapshotsTest-922618317 None] Update group completed successfully. Jul 03 16:20:47 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428" returned: 0 in 1.211s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.246s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:47 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7756afe3-2487-4f84-bebd-2aca453aeba6 tempest-SnapshotsActionsTest-889858646 None] Create snapshot completed successfully Jul 03 16:20:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-23664654-4ea9-4b6c-bbeb-e7195e7e2792 tempest-GroupSnapshotsTest-922618317 None] Update group completed successfully. Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-980f7462-9fba-4995-addf-ac96d7828428-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-980f7462-9fba-4995-addf-ac96d7828428-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Acquiring lock "cinder-quobyte-980f7462-9fba-4995-addf-ac96d7828428" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-980f7462-9fba-4995-addf-ac96d7828428" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Deleting offline snapshot 980f7462-9fba-4995-addf-ac96d7828428 of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] snapshot_file for this snap is: volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c094bb5a-6efd-429c-a099-c64c3ae42ede]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:49 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 Jul 03 16:20:49 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:50 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] GroupSnapshot 9c5627d7-46d6-4659-bd56-a89f7ddea4f6: creating. Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Group snapshot 9c5627d7-46d6-4659-bd56-a89f7ddea4f6: creating. {{(pid=86659) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Creating offline snapshot 7a0f13b3-a653-4a36-b177-2f67f337fa4b of volume 8574f45a-c361-4ca2-afc1-e80996d32d4d {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c3fa29-cf01-4a20-9857-7fd337d52897]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:50 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d Jul 03 16:20:50 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:50 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428" returned: 0 in 1.833s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1802ef6a-d7f7-42bd-8490-a7f0e17676aa]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:51 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:20:51 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:51 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d" returned: 0 in 1.228s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:51 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b 1G Jul 03 16:20:51 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:52 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 1.346s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:20:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:52 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 Jul 03 16:20:52 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:53 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b 1G" returned: 0 in 1.726s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8574f45a-c361-4ca2-afc1-e80996d32d4d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:53 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8574f45a-c361-4ca2-afc1-e80996d32d4d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b Jul 03 16:20:53 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:53 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428" returned: 0 in 1.764s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:54 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428 Jul 03 16:20:54 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:54 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8574f45a-c361-4ca2-afc1-e80996d32d4d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b" returned: 0 in 1.111s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:54 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:20:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:54 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b Jul 03 16:20:54 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:54 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.980f7462-9fba-4995-addf-ac96d7828428" returned: 0 in 0.988s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-980f7462-9fba-4995-addf-ac96d7828428" released by "_delete_snapshot" :: held 6.119s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" released by "delete_snapshot" :: held 6.174s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:55 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Created reservations ['7c247252-2621-4143-bd39-019834274162', 'a8e1fac4-8dea-4b66-b940-856de1580fa9', '5289d96a-78e0-4652-be9d-660e33cdf045', 'b8e69956-1f97-496e-89e6-46b03442330f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:20:55 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Delete snapshot completed successfully. Jul 03 16:20:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-652a07d1-de0e-4697-83d5-d7da0fe9f464 tempest-SnapshotsActionsTest-2121928278 None] Lock "cinder-980f7462-9fba-4995-addf-ac96d7828428-delete_snapshot" released by "delete_snapshot" :: held 6.444s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:20:55 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b" returned: 0 in 1.051s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:55 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.info Jul 03 16:20:55 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "cinder-e757ee27-2faa-4d7d-b37d-0d5946ba5bb9-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-e757ee27-2faa-4d7d-b37d-0d5946ba5bb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "cinder-quobyte-e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-quobyte-e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Deleting offline snapshot e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 of volume d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] snapshot_file for this snap is: volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf287d9-026e-498b-81d6-87efad6eb96d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:20:56 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:20:56 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Flow 'volume_create_manager' (761090d4-1b99-4de7-88ad-23fb2171127f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc28bcd-f24b-4106-a7d5-c1d7c446e2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc28bcd-f24b-4106-a7d5-c1d7c446e2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1330050506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53519d40-9eda-4c82-838a-28b5ad1a5750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa1d7458794f95b6f64067aba665ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:20:56Z,use_quota=True,user_id='dac3e04e4766453290add5f62920dd7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5310f72c-95e6-44da-b61c-227d20e8d16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:56 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5310f72c-95e6-44da-b61c-227d20e8d16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62f1614-27d5-491e-b947-8c80995ea7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.image.glance [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Creating Keystone auth plugin from conf {{(pid=86659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.info" returned: 0 in 0.961s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:56 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:56 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.info Jul 03 16:20:56 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62f1614-27d5-491e-b947-8c80995ea7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53519d40-9eda-4c82-838a-28b5ad1a5750', 'volume_name': 'volume-53519d40-9eda-4c82-838a-28b5ad1a5750', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dc8cb8-8d1a-45e0-b4ad-e1b78262f5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dc8cb8-8d1a-45e0-b4ad-e1b78262f5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29106bd0-fcb8-4885-93bb-fe7e75d5ccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:20:56 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Volume 53519d40-9eda-4c82-838a-28b5ad1a5750: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53519d40-9eda-4c82-838a-28b5ad1a5750', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 16:20:56 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Trying to clone 53519d40-9eda-4c82-838a-28b5ad1a5750 from image a5edd4aa-3f97-4644-9685-8001dd3a8cdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]). {{(pid=86659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 16:20:57 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Image download 20.69 MB at 20.69 MB/s Jul 03 16:20:57 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.info" returned: 0 in 0.932s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.161s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[edad8df5-f189-464f-9067-7d56bdc6c03e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Creating offline snapshot de3cb846-232c-4f86-a035-bbd8484bd971 of volume 224da1ca-a8c2-40d5-9048-1479b1bbeeb3 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bb405e-ac35-4cbc-b6db-c10783ef1e1b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:57 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 1.291s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2489ead-2d54-43e8-a879-6285a97471ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22a6483-d36a-4fae-a2de-54de310c7bba]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:57 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD Jul 03 16:20:57 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:57 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 Jul 03 16:20:57 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:57 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec Jul 03 16:20:57 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:58 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD" returned: 0 in 0.955s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:58 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Temporary image a5edd4aa-3f97-4644-9685-8001dd3a8cdd is fetched for user dac3e04e4766453290add5f62920dd7b. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 16:20:58 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec" returned: 0 in 0.926s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:58 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" returned: 0 in 1.026s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:58 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:20:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:58 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:58 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 1G Jul 03 16:20:58 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:58 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7560fad5-42f3-44bf-b466-308d855c238d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:20:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:58 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD Jul 03 16:20:58 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:59 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 0.938s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:59 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD" returned: 0 in 0.836s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:20:59 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9 Jul 03 16:20:59 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:20:59 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 03 16:20:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 1G" returned: 0 in 1.049s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:20:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:20:59 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 Jul 03 16:20:59 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:00 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec.e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" returned: 0 in 0.693s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-quobyte-e757ee27-2faa-4d7d-b37d-0d5946ba5bb9" released by "_delete_snapshot" :: held 4.024s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" released by "delete_snapshot" :: held 4.071s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:00 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Created reservations ['8ba3a89c-864a-473b-a884-207a352faf7a', '742b0070-2e6d-40db-bb33-95a738941265', '357f10b1-df55-4aeb-848c-07489da06603', '5eca643e-31c9-4a52-a5bd-1a7134663b11'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:00 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971" returned: 0 in 0.768s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:00 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:21:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:00 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Delete snapshot completed successfully. Jul 03 16:21:00 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 Jul 03 16:21:00 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-51e1cc73-052b-4c1e-894b-56d16259e4e0 tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-e757ee27-2faa-4d7d-b37d-0d5946ba5bb9-delete_snapshot" released by "delete_snapshot" :: held 4.305s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:01 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971" returned: 0 in 0.691s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:01 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.info Jul 03 16:21:01 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "cinder-d2489ead-2d54-43e8-a879-6285a97471ec-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-d2489ead-2d54-43e8-a879-6285a97471ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a7f0bc-2b04-4927-b62e-5aebf4aa6de0]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:01 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec Jul 03 16:21:01 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:01 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.info" returned: 0 in 0.711s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:01 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:21:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:01 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.info Jul 03 16:21:01 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:02 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec" returned: 0 in 0.845s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:02 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec Jul 03 16:21:02 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:02 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.info" returned: 0 in 0.675s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.023s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1330050506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53519d40-9eda-4c82-838a-28b5ad1a5750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa1d7458794f95b6f64067aba665ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:20:56Z,use_quota=True,user_id='dac3e04e4766453290add5f62920dd7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Creating volume 53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:21:02 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:21:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:02 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 1073741824 Jul 03 16:21:02 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:02 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ab87053b-aeff-4cd5-9092-685ba97eac15 tempest-GroupSnapshotsTest-922618317 None] group_snapshot 9c5627d7-46d6-4659-bd56-a89f7ddea4f6: created successfully Jul 03 16:21:03 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2489ead-2d54-43e8-a879-6285a97471ec" returned: 0 in 0.698s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-quobyte-d2489ead-2d54-43e8-a879-6285a97471ec" released by "delete_volume" :: held 1.619s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Created reservations ['c14f33f0-9879-417a-a3f0-cd9f1a96b2f7', 'c805b681-c5f1-439c-9a9a-a79bbe764fa3', 'f83f72fc-31bb-4a19-a550-40ad171a1420', 'ea2219ff-6ba9-49d7-9d39-593298d5eba9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] group_snapshot 9c5627d7-46d6-4659-bd56-a89f7ddea4f6: deleting Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] group_snapshot 9c5627d7-46d6-4659-bd56-a89f7ddea4f6: deleting {{(pid=86659) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 16:21:03 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:21:03 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-8574f45a-c361-4ca2-afc1-e80996d32d4d" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-8574f45a-c361-4ca2-afc1-e80996d32d4d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-7a0f13b3-a653-4a36-b177-2f67f337fa4b" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-7a0f13b3-a653-4a36-b177-2f67f337fa4b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Deleting offline snapshot 7a0f13b3-a653-4a36-b177-2f67f337fa4b of volume 8574f45a-c361-4ca2-afc1-e80996d32d4d {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] snapshot_file for this snap is: volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3585676-79dd-4112-97d3-0f1c5587fbda]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:03 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b Jul 03 16:21:03 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:03 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 1073741824" returned: 0 in 1.105s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:03 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 Jul 03 16:21:03 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:04 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.860s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:21:04 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Deleted volume successfully. Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c38beb7e-1c6e-45cf-81ab-2d5d4bcbcdaf tempest-SnapshotsActionsTest-889858646 None] Lock "cinder-d2489ead-2d54-43e8-a879-6285a97471ec-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:04 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750" returned: 0 in 0.800s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:04 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b" returned: 0 in 1.026s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8574f45a-c361-4ca2-afc1-e80996d32d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777ef0d-4cf6-45fa-ba1b-01ae01f42c24]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Attempting download of a5edd4aa-3f97-4644-9685-8001dd3a8cdd ((None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}])) to volume 53519d40-9eda-4c82-838a-28b5ad1a5750. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7550c6-3103-4c98-8c0b-e0f4fe18f63b]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_1i_9bzfk {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:04 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d Jul 03 16:21:04 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:04 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_1i_9bzfk Jul 03 16:21:04 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:05 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_1i_9bzfk" returned: 0 in 0.917s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_1i_9bzfk {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:05 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d" returned: 0 in 1.069s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:05 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b Jul 03 16:21:05 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:05 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_1i_9bzfk Jul 03 16:21:05 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:06 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_1i_9bzfk" returned: 1 in 0.911s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_1i_9bzfk' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:21:06 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e14f8d-d694-48b0-a380-0787ba0bfae0]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:06 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b" returned: 0 in 0.909s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:06 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b Jul 03 16:21:06 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:06 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD Jul 03 16:21:06 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:07 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d.7a0f13b3-a653-4a36-b177-2f67f337fa4b" returned: 0 in 0.823s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:07 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-7a0f13b3-a653-4a36-b177-2f67f337fa4b" released by "_delete_snapshot" :: held 3.947s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD" returned: 0 in 0.933s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] a5edd4aa-3f97-4644-9685-8001dd3a8cdd was qcow2, converting to raw {{(pid=86659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-8574f45a-c361-4ca2-afc1-e80996d32d4d" released by "delete_snapshot" :: held 3.988s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:07 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 Jul 03 16:21:07 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-de3cb846-232c-4f86-a035-bbd8484bd971" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-de3cb846-232c-4f86-a035-bbd8484bd971" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Deleting offline snapshot de3cb846-232c-4f86-a035-bbd8484bd971 of volume 224da1ca-a8c2-40d5-9048-1479b1bbeeb3 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] snapshot_file for this snap is: volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c64357-df3a-4c3f-8a06-526d8e00e299]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:07 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 Jul 03 16:21:07 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:08 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971" returned: 0 in 1.199s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:21:08 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[987348c1-3354-4666-bc47-7a27a8232f4d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:08 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 Jul 03 16:21:08 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:09 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" returned: 0 in 1.050s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:09 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 Jul 03 16:21:09 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:09 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750" returned: 0 in 2.516s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:09 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_snqvq8e_devstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:21:09 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Converted 112.00 MB image at 44.48 MB/s Jul 03 16:21:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:09 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 1G Jul 03 16:21:09 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:10 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971" returned: 0 in 0.950s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:10 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971 Jul 03 16:21:10 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:10 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 1G" returned: 0 in 0.929s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:10 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[35273d84-d908-4ac8-b091-5745ff8d4ff3]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:11 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 Jul 03 16:21:11 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:11 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3.de3cb846-232c-4f86-a035-bbd8484bd971" returned: 0 in 0.778s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-de3cb846-232c-4f86-a035-bbd8484bd971" released by "_delete_snapshot" :: held 4.127s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" released by "delete_snapshot" :: held 4.159s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:11 devstack cinder-volume[86659]: WARNING cinder.quota [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-303630750 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-303630750, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:21:11 devstack cinder-volume[86659]: WARNING cinder.quota [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-303630750 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-303630750, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:21:11 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Created reservations ['c6105db2-1718-4550-b0bc-c00e2eee4520', '4c113fd7-05c7-4aeb-b788-df39a07f9c36', 'a8dac388-393e-4376-b4fe-6ac11358d2ea', '07e34958-f691-44f8-9f0a-56ca48daaf18'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:11 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750" returned: 0 in 0.950s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:11 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] Created reservations ['8e04145c-e33e-4d03-9f41-cf07e093623f', '15af5d2e-16ec-482c-b894-d6a7cb3081f1', '31957d3c-acc2-49d7-8f5b-f8dcc2855c74', 'a2909d07-e181-46f2-9df6-174278f8c3a7'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:12 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 Jul 03 16:21:12 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7a36f56d-55ad-4fe5-bbce-f02b0fc8ac57 tempest-GroupSnapshotsTest-922618317 None] group_snapshot 9c5627d7-46d6-4659-bd56-a89f7ddea4f6: deleted successfully Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dbd8fd-4d3b-45ef-9d66-e987a7a832c6]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:12 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750" returned: 1 in 1.087s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Downloaded image a5edd4aa-3f97-4644-9685-8001dd3a8cdd ((None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}])) to volume 53519d40-9eda-4c82-838a-28b5ad1a5750 successfully. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Temporary image a5edd4aa-3f97-4644-9685-8001dd3a8cdd for user dac3e04e4766453290add5f62920dd7b is deleted. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Marking volume 53519d40-9eda-4c82-838a-28b5ad1a5750 as bootable. {{(pid=86659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Copying metadata from image a5edd4aa-3f97-4644-9685-8001dd3a8cdd to 53519d40-9eda-4c82-838a-28b5ad1a5750. {{(pid=86659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 16:21:12 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Creating volume glance metadata for volume 53519d40-9eda-4c82-838a-28b5ad1a5750 backed by image a5edd4aa-3f97-4644-9685-8001dd3a8cdd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 16:21:12 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 Jul 03 16:21:12 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29106bd0-fcb8-4885-93bb-fe7e75d5ccd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53519d40-9eda-4c82-838a-28b5ad1a5750', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fc5d28-61d8-4075-a605-e7eea958780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:13 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Volume volume-53519d40-9eda-4c82-838a-28b5ad1a5750 (53519d40-9eda-4c82-838a-28b5ad1a5750): created successfully Jul 03 16:21:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fc5d28-61d8-4075-a605-e7eea958780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Flow 'volume_create_manager' (761090d4-1b99-4de7-88ad-23fb2171127f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:13 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-32f4fc07-31e7-4ecf-b32f-d04501b225b7 tempest-VolumesExtendTest-907640913 None] Created volume successfully. Jul 03 16:21:13 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" returned: 0 in 1.029s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:13 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3 Jul 03 16:21:13 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d554df11-1939-4d15-b1fb-c89a11fd3f03]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:14 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 Jul 03 16:21:14 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:14 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" returned: 0 in 0.949s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-224da1ca-a8c2-40d5-9048-1479b1bbeeb3" released by "delete_volume" :: held 2.080s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-8574f45a-c361-4ca2-afc1-e80996d32d4d" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-8574f45a-c361-4ca2-afc1-e80996d32d4d" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f452c30-4450-41f2-a818-cc97c8ac6035]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:14 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d Jul 03 16:21:14 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:15 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750" returned: 0 in 1.149s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:15 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 Jul 03 16:21:15 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:16 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d" returned: 0 in 1.372s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:16 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d Jul 03 16:21:16 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:16 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750" returned: 1 in 1.089s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:21:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 2G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 2G" returned: 0 in 0.097s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.409s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:16 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e3f7cb14-6aa5-4e52-9b41-6e71c61bc3ef tempest-VolumesExtendTest-907640913 None] Extend volume completed successfully. Jul 03 16:21:16 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8574f45a-c361-4ca2-afc1-e80996d32d4d" returned: 0 in 0.814s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-8574f45a-c361-4ca2-afc1-e80996d32d4d" released by "delete_volume" :: held 2.266s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Created reservations ['27b51930-b0fc-4045-b071-de238e39ffa7'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Flow 'volume_create_manager' (901408a3-549d-4a87-ade9-64f5c531e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24c9b61-e66b-47a6-b221-3e332a86773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24c9b61-e66b-47a6-b221-3e332a86773b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-982962710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c6a93-ed39-475b-afeb-66cd5e7ed9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8be6677c4d44a768cf0af66dc37297c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:17Z,use_quota=True,user_id='fe4d22484e3f45dfb77fc658daaa0417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce34a69d-db29-4799-99ff-f9f24e22f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce34a69d-db29-4799-99ff-f9f24e22f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d11a1b8-ba77-4d84-bdc3-ccd1789b4919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d11a1b8-ba77-4d84-bdc3-ccd1789b4919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122c6a93-ed39-475b-afeb-66cd5e7ed9f8', 'volume_name': 'volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a80866-36a1-4771-afef-9de2721005f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a80866-36a1-4771-afef-9de2721005f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3765f2-2453-4afa-a21d-57264db7e830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:17 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Volume 122c6a93-ed39-475b-afeb-66cd5e7ed9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8', 'volume_size': 1} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-982962710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c6a93-ed39-475b-afeb-66cd5e7ed9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8be6677c4d44a768cf0af66dc37297c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:17Z,use_quota=True,user_id='fe4d22484e3f45dfb77fc658daaa0417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Creating volume 122c6a93-ed39-475b-afeb-66cd5e7ed9f8 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:21:17 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:17 devstack cinder-volume[86659]: WARNING cinder.quota [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-303630750 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-303630750, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:21:17 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 1073741824 Jul 03 16:21:17 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Created reservations ['f0840227-dff8-45c4-8e86-6e46eb1fa0cd', 'd07365d0-017f-478c-8310-169ccf7423a1', 'bd65bd9b-ad36-429a-8705-2ae233f128da', '7b75787f-9f58-4cb1-9f93-9c5176877831'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Created reservations ['c64ef214-03c7-4d0b-8d5d-3a07abc2bcf3', '6370760c-a085-4f3c-a945-3af050e7d304', '0ea8b84f-b540-43b6-a262-db17e8361095', '9faf5934-d150-4c5c-816a-e515f9d17e2c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=95,cinder:UPDATE=83,cinder:DELETE=3,cinder:INSERT=28 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:17 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:21:17 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Acquiring lock "cinder-53519d40-9eda-4c82-838a-28b5ad1a5750-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:17 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Lock "cinder-53519d40-9eda-4c82-838a-28b5ad1a5750-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=89,cinder:UPDATE=94,cinder:DELETE=4,cinder:INSERT=27 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Acquiring lock "cinder-quobyte-53519d40-9eda-4c82-838a-28b5ad1a5750" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Lock "cinder-quobyte-53519d40-9eda-4c82-838a-28b5ad1a5750" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a014934f-d5a5-44c2-9168-e576be4b1a7a]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:18 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 Jul 03 16:21:18 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e548507e-15e9-469b-a559-7a15476f781e tempest-GroupSnapshotsTest-922618317 None] Group tempest-GroupSnapshotsTest-Group-1272603876: creating Jul 03 16:21:18 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 1073741824" returned: 0 in 1.268s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e548507e-15e9-469b-a559-7a15476f781e tempest-GroupSnapshotsTest-922618317 None] Group tempest-GroupSnapshotsTest-Group-1272603876: created successfully Jul 03 16:21:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e548507e-15e9-469b-a559-7a15476f781e tempest-GroupSnapshotsTest-922618317 None] Create group completed successfully. Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:18 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 Jul 03 16:21:18 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:18 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.912s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:21:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-78f87573-857a-4b76-a3cb-eae555f20b3e tempest-GroupSnapshotsTest-922618317 None] Delete group completed successfully. Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:18 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:21:18 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:19 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750" returned: 0 in 1.013s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:19 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 Jul 03 16:21:19 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:19 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8" returned: 0 in 0.746s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3765f2-2453-4afa-a21d-57264db7e830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd5604e-9183-40b4-991c-905805547048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:19 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Volume volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 (122c6a93-ed39-475b-afeb-66cd5e7ed9f8): created successfully Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd5604e-9183-40b4-991c-905805547048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Flow 'volume_create_manager' (901408a3-549d-4a87-ade9-64f5c531e57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:19 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3884b10e-1679-459f-bdf9-dbff4929b9d1 tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Created volume successfully. Jul 03 16:21:19 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.949s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:21:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:21:20 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750" returned: 1 in 0.940s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:20 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750 Jul 03 16:21:20 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Flow 'volume_create_manager' (e3341f7c-35bc-463c-9a0b-c266b0ee7dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257d5ae3-3e5c-4134-b648-8d79cd23bef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257d5ae3-3e5c-4134-b648-8d79cd23bef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1718901102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f90b560-de64-46a6-87e0-21c233cc7859,host='devstack@QuobyteHD#QuobyteHD',id=7ccebc8d-4ba1-4520-9483-cdacba497092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593bd8d9603a45589c26eadb65c758ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:20Z,use_quota=True,user_id='d8b8c2c932764807b4a1da0ae452a0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1900b4-d51f-4380-ab90-34a4047777f6),volume_type_id=ee1900b4-d51f-4380-ab90-34a4047777f6)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfed2ef-3b76-4fc6-b02f-489046addb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfed2ef-3b76-4fc6-b02f-489046addb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2d6fba-d6b0-4985-b558-c7e0cad7cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2d6fba-d6b0-4985-b558-c7e0cad7cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ccebc8d-4ba1-4520-9483-cdacba497092', 'volume_name': 'volume-7ccebc8d-4ba1-4520-9483-cdacba497092', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158d6b99-8131-469d-aa96-40b0de503745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158d6b99-8131-469d-aa96-40b0de503745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfa6acc-2cea-4074-a034-7c73771c54f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:20 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Volume 7ccebc8d-4ba1-4520-9483-cdacba497092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ccebc8d-4ba1-4520-9483-cdacba497092', 'volume_size': 1} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f90b560-de64-46a6-87e0-21c233cc7859,created_at=2026-07-03T14:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1718901102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f90b560-de64-46a6-87e0-21c233cc7859,host='devstack@QuobyteHD#QuobyteHD',id=7ccebc8d-4ba1-4520-9483-cdacba497092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593bd8d9603a45589c26eadb65c758ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:20Z,use_quota=True,user_id='d8b8c2c932764807b4a1da0ae452a0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1900b4-d51f-4380-ab90-34a4047777f6),volume_type_id=ee1900b4-d51f-4380-ab90-34a4047777f6)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Creating volume 7ccebc8d-4ba1-4520-9483-cdacba497092 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:21:20 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:20 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 1073741824 Jul 03 16:21:20 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:20 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53519d40-9eda-4c82-838a-28b5ad1a5750" returned: 0 in 0.797s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Lock "cinder-quobyte-53519d40-9eda-4c82-838a-28b5ad1a5750" released by "delete_volume" :: held 2.857s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Created reservations ['7b1a69ba-cb0e-447d-9d44-7fbf1219dc49', '924616a5-b44c-4697-bd4d-b5e693dfc014', '30f62b55-e59e-4b5d-adc7-643c9bf13467', '92e9efcb-7f38-473b-b1fc-1e54d70a6b92'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:21 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:21:21 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:21 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 1073741824" returned: 0 in 1.146s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:21 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 Jul 03 16:21:21 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Acquiring lock "cinder-122c6a93-ed39-475b-afeb-66cd5e7ed9f8-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "cinder-122c6a93-ed39-475b-afeb-66cd5e7ed9f8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Acquiring lock "cinder-quobyte-122c6a93-ed39-475b-afeb-66cd5e7ed9f8" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "cinder-quobyte-122c6a93-ed39-475b-afeb-66cd5e7ed9f8" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4089db09-28ae-4ad7-890b-cd38492a1980]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Flow 'volume_create_manager' (dcc78e14-86cc-4754-b9c3-23a2a503fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d086c1a-a2ac-4e52-b7de-eb819c6a31a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:22 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d086c1a-a2ac-4e52-b7de-eb819c6a31a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-688932893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc917587-8c4c-4c20-a16a-deb9b9cc1074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa1d7458794f95b6f64067aba665ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:22Z,use_quota=True,user_id='dac3e04e4766453290add5f62920dd7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97dd3f0-c5b9-4464-bcf6-cf5414d7d936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97dd3f0-c5b9-4464-bcf6-cf5414d7d936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d48c56d-609b-4ec6-a246-1b51c3b9cc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d48c56d-609b-4ec6-a246-1b51c3b9cc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc917587-8c4c-4c20-a16a-deb9b9cc1074', 'volume_name': 'volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908e4f7a-30b7-420b-b443-43a131b1acdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908e4f7a-30b7-420b-b443-43a131b1acdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e4a2e8-8b44-4480-8384-b87b22f58ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:22 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Volume fc917587-8c4c-4c20-a16a-deb9b9cc1074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074', 'volume_size': 1} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:22 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 Jul 03 16:21:22 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.049s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:21:22 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Deleted volume successfully. Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9080e802-9e89-4067-b2e2-44075313e9b5 tempest-VolumesExtendTest-907640913 None] Lock "cinder-53519d40-9eda-4c82-838a-28b5ad1a5750-delete_volume" released by "delete_volume" :: held 4.219s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:22 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092" returned: 0 in 0.886s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-688932893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc917587-8c4c-4c20-a16a-deb9b9cc1074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fa1d7458794f95b6f64067aba665ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:22Z,use_quota=True,user_id='dac3e04e4766453290add5f62920dd7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Creating volume fc917587-8c4c-4c20-a16a-deb9b9cc1074 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:21:22 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:22 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 1073741824 Jul 03 16:21:22 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfa6acc-2cea-4074-a034-7c73771c54f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ccebc8d-4ba1-4520-9483-cdacba497092', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5024b41b-c2cb-472a-8720-10be4dbdd8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:22 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Volume volume-7ccebc8d-4ba1-4520-9483-cdacba497092 (7ccebc8d-4ba1-4520-9483-cdacba497092): created successfully Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5024b41b-c2cb-472a-8720-10be4dbdd8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Flow 'volume_create_manager' (e3341f7c-35bc-463c-9a0b-c266b0ee7dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:22 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-68e2f67a-e389-48f2-b9d5-dfe834f7fa48 tempest-GroupSnapshotsTest-922618317 None] Created volume successfully. Jul 03 16:21:23 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8" returned: 0 in 1.048s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:23 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8 Jul 03 16:21:23 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:23 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 1073741824" returned: 0 in 1.137s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:23 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-122c6a93-ed39-475b-afeb-66cd5e7ed9f8" returned: 0 in 0.771s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:23 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 Jul 03 16:21:23 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "cinder-quobyte-122c6a93-ed39-475b-afeb-66cd5e7ed9f8" released by "delete_volume" :: held 1.877s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:23 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Created reservations ['3368f1f1-86ce-44bc-b30c-86f182542cc4', '0c480d38-6626-4ee2-8375-b65934921acd', '2701ace6-0423-46aa-bddf-8a2d5e17cfa2', '6ec360e4-4020-4f48-84b6-470a715e36a0'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:24 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:21:24 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:24 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] GroupSnapshot 0f5cfc8f-768f-474d-8957-59e5f5520b48: creating. Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Group snapshot 0f5cfc8f-768f-474d-8957-59e5f5520b48: creating. {{(pid=86659) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:24 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074" returned: 0 in 0.776s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.135s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Creating offline snapshot 5e58ff2f-bc16-43d8-a7b8-236009a8a4cc of volume 7ccebc8d-4ba1-4520-9483-cdacba497092 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e4a2e8-8b44-4480-8384-b87b22f58ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7af1e8-347a-46ad-b6ba-6be5b86ed674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e49f92-1574-44df-a14b-9a3703610403]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:24 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Volume volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 (fc917587-8c4c-4c20-a16a-deb9b9cc1074): created successfully Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7af1e8-347a-46ad-b6ba-6be5b86ed674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Flow 'volume_create_manager' (dcc78e14-86cc-4754-b9c3-23a2a503fb70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:24 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a9da926a-f206-4f3b-b23c-21117ab9c962 tempest-VolumesExtendTest-907640913 None] Created volume successfully. Jul 03 16:21:24 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 Jul 03 16:21:24 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:24 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.857s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:21:24 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Deleted volume successfully. Jul 03 16:21:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-1d5f5f74-31ef-42bd-847a-8fe1d7436d6b tempest-VolumeQuotasNegativeTestJSON-1418188595 None] Lock "cinder-122c6a93-ed39-475b-afeb-66cd5e7ed9f8-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-b193274f-ac23-483b-a681-2822319c46b4 req-aa4d794c-05bf-4230-b884-18d7e70925c1 tempest-AttachVolumeNegativeTest-2091901602 None] Terminate volume connection completed successfully. Jul 03 16:21:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-b193274f-ac23-483b-a681-2822319c46b4 req-aa4d794c-05bf-4230-b884-18d7e70925c1 tempest-AttachVolumeNegativeTest-2091901602 None] Deleting attachment 7e9fff9d-a8ab-4a85-8c97-2cd91fe04d90. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:21:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:25 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092" returned: 0 in 0.966s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:25 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc 1G Jul 03 16:21:25 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:26 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc 1G" returned: 0 in 1.066s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccebc8d-4ba1-4520-9483-cdacba497092 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:26 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccebc8d-4ba1-4520-9483-cdacba497092 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc Jul 03 16:21:26 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:27 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ccebc8d-4ba1-4520-9483-cdacba497092 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc" returned: 0 in 0.820s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:27 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:21:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:27 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc Jul 03 16:21:27 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:28 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc" returned: 0 in 0.800s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:28 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.info Jul 03 16:21:28 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:29 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.info" returned: 0 in 0.997s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:29 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:21:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:29 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.info Jul 03 16:21:29 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:30 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.info" returned: 0 in 0.722s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.524s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.609s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Creating offline snapshot 7f2fe2eb-d717-4a42-a311-5306a3f3b581 of volume fc917587-8c4c-4c20-a16a-deb9b9cc1074 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:21:30 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8104f43d-8298-48cf-a535-7f5837bde9be]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:30 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0f39793a-fd3f-4702-ad29-c41e7bb57fa5 tempest-GroupSnapshotsTest-922618317 None] group_snapshot 0f5cfc8f-768f-474d-8957-59e5f5520b48: created successfully Jul 03 16:21:30 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 Jul 03 16:21:30 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:31 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] group_snapshot 0f5cfc8f-768f-474d-8957-59e5f5520b48: deleting Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] group_snapshot 0f5cfc8f-768f-474d-8957-59e5f5520b48: deleting {{(pid=86659) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-7ccebc8d-4ba1-4520-9483-cdacba497092" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-7ccebc8d-4ba1-4520-9483-cdacba497092" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-5e58ff2f-bc16-43d8-a7b8-236009a8a4cc" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-5e58ff2f-bc16-43d8-a7b8-236009a8a4cc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Deleting offline snapshot 5e58ff2f-bc16-43d8-a7b8-236009a8a4cc of volume 7ccebc8d-4ba1-4520-9483-cdacba497092 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] snapshot_file for this snap is: volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e334f760-f7ae-4df3-9f3d-be69f8dbebb5]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Flow 'volume_create_manager' (ad29f5e2-f46f-4d50-8663-75e9435e969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415a102f-50ab-4725-b595-b1c4a4adfa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415a102f-50ab-4725-b595-b1c4a4adfa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1021001869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c598bc-4738-4ebc-b61b-7d34f09f8764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fc561280af4c1bb5088f317406260e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:31Z,use_quota=True,user_id='0916eb0c240c4236a029ec2a8ac1bdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f769de25-7828-403b-9ba2-7b1725e8b819),volume_type_id=f769de25-7828-403b-9ba2-7b1725e8b819)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:31 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc Jul 03 16:21:31 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:31 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84dd2e7a-68a0-4322-aaf2-065d1761412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84dd2e7a-68a0-4322-aaf2-065d1761412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce828a3-a97b-498c-a442-42acd5609147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce828a3-a97b-498c-a442-42acd5609147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c598bc-4738-4ebc-b61b-7d34f09f8764', 'volume_name': 'volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e1c839-83c9-4eee-8fb9-27145bff8061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e1c839-83c9-4eee-8fb9-27145bff8061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254a11bc-c016-4acf-bb88-c6479805cd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:31 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Volume f6c598bc-4738-4ebc-b61b-7d34f09f8764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764', 'volume_size': 1} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074" returned: 0 in 1.156s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:31 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 1G Jul 03 16:21:31 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:32 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc" returned: 0 in 0.889s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ccebc8d-4ba1-4520-9483-cdacba497092(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:21:32 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b48339-c4be-421f-a8be-5cb64762f982]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:32 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 Jul 03 16:21:32 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:32 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 1G" returned: 0 in 0.912s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:32 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 Jul 03 16:21:32 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:32 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092" returned: 0 in 0.811s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:32 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc Jul 03 16:21:32 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:33 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581" returned: 0 in 0.755s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:33 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 is being set with open permissions: ugo+rw Jul 03 16:21:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:33 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 Jul 03 16:21:33 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:33 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc" returned: 0 in 0.716s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:33 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc Jul 03 16:21:33 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:33 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581" returned: 0 in 0.691s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:33 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.info Jul 03 16:21:33 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:34 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092.5e58ff2f-bc16-43d8-a7b8-236009a8a4cc" returned: 0 in 0.685s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-5e58ff2f-bc16-43d8-a7b8-236009a8a4cc" released by "_delete_snapshot" :: held 3.246s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-7ccebc8d-4ba1-4520-9483-cdacba497092" released by "delete_snapshot" :: held 3.282s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:34 devstack cinder-volume[86659]: WARNING cinder.quota [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1566981012 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1566981012, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:21:34 devstack cinder-volume[86659]: WARNING cinder.quota [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1566981012 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1566981012, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:21:34 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] Created reservations ['fc18d4d7-707e-40ed-85cd-5b8296bc664e', '7bb15613-97ea-433f-93b5-6c509d456785', 'cf6ea3aa-53d1-4ed2-8441-046748d3436f', '060c9f56-7c55-4ba0-926f-5526d1784698'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:34 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.info" returned: 0 in 0.777s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:34 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.info is being set with open permissions: ugo+rw Jul 03 16:21:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:34 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.info Jul 03 16:21:34 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a84f632d-efef-4c30-a95c-925b12617ce2 tempest-GroupSnapshotsTest-922618317 None] group_snapshot 0f5cfc8f-768f-474d-8957-59e5f5520b48: deleted successfully Jul 03 16:21:35 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.info" returned: 0 in 0.691s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.141s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.887s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1021001869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c598bc-4738-4ebc-b61b-7d34f09f8764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fc561280af4c1bb5088f317406260e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:31Z,use_quota=True,user_id='0916eb0c240c4236a029ec2a8ac1bdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f769de25-7828-403b-9ba2-7b1725e8b819),volume_type_id=f769de25-7828-403b-9ba2-7b1725e8b819)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Creating volume f6c598bc-4738-4ebc-b61b-7d34f09f8764 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:21:35 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:35 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 1073741824 Jul 03 16:21:35 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:35 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0abff010-ec8f-4523-9fcf-a99bcf7d9c10 tempest-VolumesExtendTest-907640913 None] Create snapshot completed successfully Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "cinder-quobyte-7ccebc8d-4ba1-4520-9483-cdacba497092" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-7ccebc8d-4ba1-4520-9483-cdacba497092" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b1133-a040-4dea-acc0-5dee7eef17bd]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:36 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 Jul 03 16:21:36 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-581db535-5b89-4edf-83df-61f86c233e54 tempest-VolumesExtendTest-907640913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:36 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 1073741824" returned: 0 in 1.122s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:36 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 Jul 03 16:21:36 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:36 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092" returned: 0 in 1.007s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:37 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092 Jul 03 16:21:37 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:37 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764" returned: 0 in 0.695s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-581db535-5b89-4edf-83df-61f86c233e54 tempest-VolumesExtendTest-907640913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.960s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254a11bc-c016-4acf-bb88-c6479805cd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d770357-cf33-4577-8495-36728bade177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[800b5e8d-0232-45a4-b1cd-1744d3deefc4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-581db535-5b89-4edf-83df-61f86c233e54 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Volume volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 (f6c598bc-4738-4ebc-b61b-7d34f09f8764): created successfully Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d770357-cf33-4577-8495-36728bade177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Flow 'volume_create_manager' (ad29f5e2-f46f-4d50-8663-75e9435e969a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4c56e59f-273d-46c6-a819-68490a24a7db tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Created volume successfully. Jul 03 16:21:37 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 Jul 03 16:21:37 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:37 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7ccebc8d-4ba1-4520-9483-cdacba497092" returned: 0 in 0.879s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Lock "cinder-quobyte-7ccebc8d-4ba1-4520-9483-cdacba497092" released by "delete_volume" :: held 1.960s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Created reservations ['9915b1a5-c3d9-4820-987f-3550827189a2'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:38 devstack cinder-volume[86659]: WARNING cinder.quota [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1566981012 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1566981012, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Created reservations ['bc9aed01-812f-4e25-aa94-b13f51f5793b', '51f9844f-9d8b-446e-9bc6-fdab298b763f', '9aa6f87b-51d6-434d-8242-c4f774ccdf64', '2f5def71-fb10-424b-a551-df79e7d8ce53'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:38 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-581db535-5b89-4edf-83df-61f86c233e54 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074" returned: 0 in 1.027s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-581db535-5b89-4edf-83df-61f86c233e54 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 2G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fdf56e37-2028-4144-84f0-0fb9aaa8e95b tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fdf56e37-2028-4144-84f0-0fb9aaa8e95b tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fdf56e37-2028-4144-84f0-0fb9aaa8e95b tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fdf56e37-2028-4144-84f0-0fb9aaa8e95b tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fdf56e37-2028-4144-84f0-0fb9aaa8e95b tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fdf56e37-2028-4144-84f0-0fb9aaa8e95b tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:38 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:21:38 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:38 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:21:38 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-581db535-5b89-4edf-83df-61f86c233e54 tempest-VolumesExtendTest-907640913 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 2G" returned: 0 in 0.188s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-581db535-5b89-4edf-83df-61f86c233e54 tempest-VolumesExtendTest-907640913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.271s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-581db535-5b89-4edf-83df-61f86c233e54 tempest-VolumesExtendTest-907640913 None] Extend volume completed successfully. Jul 03 16:21:39 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fdf56e37-2028-4144-84f0-0fb9aaa8e95b tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.942s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-fdf56e37-2028-4144-84f0-0fb9aaa8e95b tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:21:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fdf56e37-2028-4144-84f0-0fb9aaa8e95b tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Retype volume completed successfully. Jul 03 16:21:39 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.983s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:21:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-25a1dd63-51ef-497d-93ce-369130d26bcc tempest-GroupSnapshotsTest-922618317 None] Delete group completed successfully. Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Acquiring lock "cinder-f6c598bc-4738-4ebc-b61b-7d34f09f8764-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "cinder-f6c598bc-4738-4ebc-b61b-7d34f09f8764-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Acquiring lock "cinder-7f2fe2eb-d717-4a42-a311-5306a3f3b581-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Acquiring lock "cinder-quobyte-f6c598bc-4738-4ebc-b61b-7d34f09f8764" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Lock "cinder-7f2fe2eb-d717-4a42-a311-5306a3f3b581-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Acquiring lock "cinder-quobyte-fc917587-8c4c-4c20-a16a-deb9b9cc1074" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "cinder-quobyte-f6c598bc-4738-4ebc-b61b-7d34f09f8764" acquired by "delete_volume" :: waited 0.043s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Lock "cinder-quobyte-fc917587-8c4c-4c20-a16a-deb9b9cc1074" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Acquiring lock "cinder-quobyte-7f2fe2eb-d717-4a42-a311-5306a3f3b581" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eff51d-e676-4815-9182-ba55ce4d73c6]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Lock "cinder-quobyte-7f2fe2eb-d717-4a42-a311-5306a3f3b581" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Deleting offline snapshot 7f2fe2eb-d717-4a42-a311-5306a3f3b581 of volume fc917587-8c4c-4c20-a16a-deb9b9cc1074 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] snapshot_file for this snap is: volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eb4271-7f71-46c8-b8a3-811d3a99dd53]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:39 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 Jul 03 16:21:39 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:40 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 Jul 03 16:21:40 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:40 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764" returned: 0 in 0.956s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:40 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764 Jul 03 16:21:40 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:40 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581" returned: 0 in 0.990s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:21:40 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c56216-30e0-4429-a887-ce8265c416ba]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:41 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 Jul 03 16:21:41 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f6c598bc-4738-4ebc-b61b-7d34f09f8764" returned: 0 in 0.861s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:41 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "cinder-quobyte-f6c598bc-4738-4ebc-b61b-7d34f09f8764" released by "delete_volume" :: held 1.872s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:41 devstack cinder-volume[86659]: WARNING cinder.quota [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:21:41 devstack cinder-volume[86659]: WARNING cinder.quota [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:21:41 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Created reservations ['f7304efc-ae75-4681-91c2-053b3ec9a53c', '23c584de-bfca-4e4f-9fb1-dbf179123f18', 'e2a33c6d-1c44-452c-8686-4715de2e0fd1', 'ba3b075f-7bf7-4556-ac1a-ff233be786df'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:41 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:21:41 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:42 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074" returned: 0 in 1.168s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:42 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 Jul 03 16:21:42 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:42 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.909s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:42 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:21:42 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Deleted volume successfully. Jul 03 16:21:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f4670c91-be7a-44ac-b2b6-407d1f87c540 tempest-VolumeRetypeWithoutMigrationTest-1973015302 None] Lock "cinder-f6c598bc-4738-4ebc-b61b-7d34f09f8764-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:43 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581" returned: 0 in 1.129s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:43 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581 Jul 03 16:21:43 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:44 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074.7f2fe2eb-d717-4a42-a311-5306a3f3b581" returned: 0 in 0.827s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Lock "cinder-quobyte-7f2fe2eb-d717-4a42-a311-5306a3f3b581" released by "_delete_snapshot" :: held 4.289s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Lock "cinder-quobyte-fc917587-8c4c-4c20-a16a-deb9b9cc1074" released by "delete_snapshot" :: held 4.364s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:44 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Created reservations ['9be0924f-2d15-4b3e-84ea-4690a600ef6f', 'e563e3df-94d4-44c2-95ab-d2053e05cc84', '3dea2758-5086-4085-b95e-e7a06b880511', '555d6e6e-370b-4383-8b70-1ffaa84b15a6'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Delete snapshot completed successfully. Jul 03 16:21:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d433d937-0ab5-48a8-a39a-8537f4e2d413 tempest-VolumesExtendTest-907640913 None] Lock "cinder-7f2fe2eb-d717-4a42-a311-5306a3f3b581-delete_snapshot" released by "delete_snapshot" :: held 4.608s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Acquiring lock "cinder-fc917587-8c4c-4c20-a16a-deb9b9cc1074-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Lock "cinder-fc917587-8c4c-4c20-a16a-deb9b9cc1074-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Acquiring lock "cinder-quobyte-fc917587-8c4c-4c20-a16a-deb9b9cc1074" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Lock "cinder-quobyte-fc917587-8c4c-4c20-a16a-deb9b9cc1074" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:45 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6c111a-b1ab-431e-bdca-f243d3fa6caf]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:45 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 Jul 03 16:21:45 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:46 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4c52b4d9-7ab2-4b5d-adb8-769a262ef410 tempest-GroupSnapshotsV319Test-1840974193 None] Group tempest-GroupSnapshotsV319Test-Group-900274270: creating Jul 03 16:21:46 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4c52b4d9-7ab2-4b5d-adb8-769a262ef410 tempest-GroupSnapshotsV319Test-1840974193 None] Group tempest-GroupSnapshotsV319Test-Group-900274270: created successfully Jul 03 16:21:46 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4c52b4d9-7ab2-4b5d-adb8-769a262ef410 tempest-GroupSnapshotsV319Test-1840974193 None] Create group completed successfully. Jul 03 16:21:46 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074" returned: 0 in 0.971s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:46 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074 Jul 03 16:21:46 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:47 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-fc917587-8c4c-4c20-a16a-deb9b9cc1074" returned: 0 in 0.937s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Lock "cinder-quobyte-fc917587-8c4c-4c20-a16a-deb9b9cc1074" released by "delete_volume" :: held 2.010s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:47 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Created reservations ['29c57a21-25fb-4bd0-a842-3a762337d892', '30daa8aa-be47-4011-ba4c-8de2743ef0cb', 'c6d0c6d9-e5cb-4908-af95-18ff9b366fe1', 'c09af95a-50a1-4c55-ab52-04ca84549f53'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:21:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:47 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:21:47 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Flow 'volume_create_manager' (401aac7f-e81e-43f1-bb72-b25252af7e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65394aca-5095-4004-92c5-5d71f307ff8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65394aca-5095-4004-92c5-5d71f307ff8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-296870010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6be751c0-e7c6-430c-97db-5664b68617a5,host='devstack@QuobyteHD#QuobyteHD',id=5a2ec589-90d4-4baf-9356-c7706cf1474e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5158f24b0e64d2798a8aae7e5d56a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:48Z,use_quota=True,user_id='8d79a1a5d2a64e19aa7653ef99db0ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78492010-9b69-40d0-b832-1163189d71c6),volume_type_id=78492010-9b69-40d0-b832-1163189d71c6)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed327973-de1c-462b-9d93-96beb6f7c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed327973-de1c-462b-9d93-96beb6f7c25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a22ed1-27d6-4b75-8d55-d3e30433eebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a22ed1-27d6-4b75-8d55-d3e30433eebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2ec589-90d4-4baf-9356-c7706cf1474e', 'volume_name': 'volume-5a2ec589-90d4-4baf-9356-c7706cf1474e', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b077da95-a052-4642-8716-8857f9b72710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b077da95-a052-4642-8716-8857f9b72710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34881692-55d5-4f6f-8e5e-9b5652b6db73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:48 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Volume 5a2ec589-90d4-4baf-9356-c7706cf1474e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2ec589-90d4-4baf-9356-c7706cf1474e', 'volume_size': 1} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6be751c0-e7c6-430c-97db-5664b68617a5,created_at=2026-07-03T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-296870010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6be751c0-e7c6-430c-97db-5664b68617a5,host='devstack@QuobyteHD#QuobyteHD',id=5a2ec589-90d4-4baf-9356-c7706cf1474e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5158f24b0e64d2798a8aae7e5d56a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:48Z,use_quota=True,user_id='8d79a1a5d2a64e19aa7653ef99db0ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78492010-9b69-40d0-b832-1163189d71c6),volume_type_id=78492010-9b69-40d0-b832-1163189d71c6)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Creating volume 5a2ec589-90d4-4baf-9356-c7706cf1474e {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:21:48 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:48 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e 1073741824 Jul 03 16:21:48 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.859s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:21:48 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Deleted volume successfully. Jul 03 16:21:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c646f367-76ca-4351-a780-68c12ab7d636 tempest-VolumesExtendTest-907640913 None] Lock "cinder-fc917587-8c4c-4c20-a16a-deb9b9cc1074-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:21:49 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e 1073741824" returned: 0 in 1.375s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:49 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e Jul 03 16:21:49 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:50 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e" returned: 0 in 0.856s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:21:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34881692-55d5-4f6f-8e5e-9b5652b6db73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2ec589-90d4-4baf-9356-c7706cf1474e', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8139f529-cf4f-4068-a6a9-2104a178dff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:50 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Volume volume-5a2ec589-90d4-4baf-9356-c7706cf1474e (5a2ec589-90d4-4baf-9356-c7706cf1474e): created successfully Jul 03 16:21:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8139f529-cf4f-4068-a6a9-2104a178dff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Flow 'volume_create_manager' (401aac7f-e81e-43f1-bb72-b25252af7e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:50 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-019cacf8-5f1c-4908-aa6e-52df8b215855 tempest-GroupSnapshotsV319Test-1840974193 None] Created volume successfully. Jul 03 16:21:50 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:21:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Flow 'volume_create_manager' (06f1f51c-9451-4f90-8f3d-6715a7929c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cac7274-c6b4-4c86-91da-7107fe50b94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cac7274-c6b4-4c86-91da-7107fe50b94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-994170808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c954b1-cf73-4de0-bdd6-ea189fdfce4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1900680499d4cb7a51588f6555ab233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:51Z,use_quota=True,user_id='4fa8a172e0a34b9cbe9f641f3329b2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b42d20-59fc-4f5b-9d1a-ef47ec17f03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b42d20-59fc-4f5b-9d1a-ef47ec17f03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e92ff4-e2b2-4b50-8fb9-93dc68b13be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e92ff4-e2b2-4b50-8fb9-93dc68b13be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c954b1-cf73-4de0-bdd6-ea189fdfce4c', 'volume_name': 'volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fcfb2c-649f-455b-a0c5-ae235fee2ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fcfb2c-649f-455b-a0c5-ae235fee2ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09861c95-c117-46ca-8e09-f3cb4c6c0833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Volume e6c954b1-cf73-4de0-bdd6-ea189fdfce4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c', 'volume_size': 1} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-994170808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c954b1-cf73-4de0-bdd6-ea189fdfce4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1900680499d4cb7a51588f6555ab233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:51Z,use_quota=True,user_id='4fa8a172e0a34b9cbe9f641f3329b2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Creating volume e6c954b1-cf73-4de0-bdd6-ea189fdfce4c {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:21:51 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:21:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:51 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c 1073741824 Jul 03 16:21:51 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:52 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c 1073741824" returned: 0 in 1.098s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:52 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c Jul 03 16:21:52 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:52 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] GroupSnapshot cda6e37a-0bd1-489b-a415-b0f65665e475: creating. Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Group snapshot cda6e37a-0bd1-489b-a415-b0f65665e475: creating. {{(pid=86659) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (02c25ec5-6bc1-4c0d-ac19-af11ea910bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a0b636-bdf2-426f-ba3a-21e6644b2310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a0b636-bdf2-426f-ba3a-21e6644b2310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-115090509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f468011-3d5d-4662-945a-c63525425634,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:53Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f42e36a-e344-4f1c-8284-c8208e52cf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f42e36a-e344-4f1c-8284-c8208e52cf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1939d385-7c1c-4cd4-8b50-adc0c66e596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1939d385-7c1c-4cd4-8b50-adc0c66e596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f468011-3d5d-4662-945a-c63525425634', 'volume_name': 'volume-1f468011-3d5d-4662-945a-c63525425634', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf73438-4467-47a5-8ff2-fd6db47032c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf73438-4467-47a5-8ff2-fd6db47032c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87dfba4-fd13-4fbb-8b15-7e3a5f3cdbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:52 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Volume 1f468011-3d5d-4662-945a-c63525425634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f468011-3d5d-4662-945a-c63525425634', 'volume_size': 1} Jul 03 16:21:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:53 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" returned: 0 in 0.818s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.629s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Creating offline snapshot 0ab5713f-99bd-4cc4-82f1-c3089c355198 of volume 5a2ec589-90d4-4baf-9356-c7706cf1474e {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09861c95-c117-46ca-8e09-f3cb4c6c0833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c019223-0ce6-4dd8-b2ac-afedf45b75a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[98954791-30da-46d6-9af5-f54f81809a7d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:53 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Volume volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c (e6c954b1-cf73-4de0-bdd6-ea189fdfce4c): created successfully Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c019223-0ce6-4dd8-b2ac-afedf45b75a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Flow 'volume_create_manager' (06f1f51c-9451-4f90-8f3d-6715a7929c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:21:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d6f3804e-9732-445f-8c8b-751a8506274b tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Created volume successfully. Jul 03 16:21:53 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e Jul 03 16:21:53 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:53 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e" returned: 0 in 0.809s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:53 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 1G Jul 03 16:21:53 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:55 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 1G" returned: 0 in 1.325s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2ec589-90d4-4baf-9356-c7706cf1474e -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:55 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2ec589-90d4-4baf-9356-c7706cf1474e -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 Jul 03 16:21:55 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:56 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2ec589-90d4-4baf-9356-c7706cf1474e -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198" returned: 0 in 0.921s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:56 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:21:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:56 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 Jul 03 16:21:56 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:56 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198" returned: 0 in 0.770s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:57 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.info Jul 03 16:21:57 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.info" returned: 0 in 0.766s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:57 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 16:21:57 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:57 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.info Jul 03 16:21:57 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:58 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.info" returned: 0 in 0.797s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.511s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.626s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-115090509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f468011-3d5d-4662-945a-c63525425634,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:21:53Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Creating volume 1f468011-3d5d-4662-945a-c63525425634 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:21:58 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:21:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:58 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634 1073741824 Jul 03 16:21:58 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-be6cc35b-36b0-4246-8913-4c92d662df0d tempest-GroupSnapshotsV319Test-1840974193 None] group_snapshot cda6e37a-0bd1-489b-a415-b0f65665e475: created successfully Jul 03 16:21:59 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] group_snapshot cda6e37a-0bd1-489b-a415-b0f65665e475: deleting Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] group_snapshot cda6e37a-0bd1-489b-a415-b0f65665e475: deleting {{(pid=86659) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Acquiring lock "cinder-quobyte-5a2ec589-90d4-4baf-9356-c7706cf1474e" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "cinder-quobyte-5a2ec589-90d4-4baf-9356-c7706cf1474e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Acquiring lock "cinder-quobyte-0ab5713f-99bd-4cc4-82f1-c3089c355198" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "cinder-quobyte-0ab5713f-99bd-4cc4-82f1-c3089c355198" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Deleting offline snapshot 0ab5713f-99bd-4cc4-82f1-c3089c355198 of volume 5a2ec589-90d4-4baf-9356-c7706cf1474e {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] snapshot_file for this snap is: volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fdc365-ef93-4a5c-a89c-7d67f0140734]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:59 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 Jul 03 16:21:59 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:21:59 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634 1073741824" returned: 0 in 1.292s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:21:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:21:59 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634 Jul 03 16:21:59 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:00 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634" returned: 0 in 0.751s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.352s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87dfba4-fd13-4fbb-8b15-7e3a5f3cdbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f468011-3d5d-4662-945a-c63525425634', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c5be95-523a-4834-b6cc-7adb8d42190c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:00 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198" returned: 0 in 1.094s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2ec589-90d4-4baf-9356-c7706cf1474e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Creating offline snapshot 36086eb8-88d8-4396-91a2-eea30d851c1a of volume e6c954b1-cf73-4de0-bdd6-ea189fdfce4c {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f977dbe-ed27-41f2-b007-cac7403312ac]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e97f837-7803-4049-91e8-29b33515497c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:00 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Volume volume-1f468011-3d5d-4662-945a-c63525425634 (1f468011-3d5d-4662-945a-c63525425634): created successfully Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c5be95-523a-4834-b6cc-7adb8d42190c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (02c25ec5-6bc1-4c0d-ac19-af11ea910bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:00 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-8823051d-bf8e-4f7c-a167-6993b7aef526 tempest-VolumesGetTest-1378786862 None] Created volume successfully. Jul 03 16:22:00 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e Jul 03 16:22:00 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:00 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c Jul 03 16:22:00 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:01 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e" returned: 0 in 0.975s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:01 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" returned: 0 in 0.958s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:01 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 Jul 03 16:22:01 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:01 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a 1G Jul 03 16:22:01 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (1b66dcb5-fc0f-4dd7-8a9a-4f1263bdcc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021eb4dc-8f3f-45b6-a137-be3fdf2b1d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021eb4dc-8f3f-45b6-a137-be3fdf2b1d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1521561415',display_name='tempest-VolumesGetTest-Volume-1789016776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a0768d-c587-47f4-af41-bac67eb7fcf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:03Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec6f591-4d54-4aa5-bbff-e9a04757753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec6f591-4d54-4aa5-bbff-e9a04757753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd43dae-b3a3-48a7-9b71-f276ea19a98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd43dae-b3a3-48a7-9b71-f276ea19a98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a0768d-c587-47f4-af41-bac67eb7fcf4', 'volume_name': 'volume-53a0768d-c587-47f4-af41-bac67eb7fcf4', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe98aa91-86db-48be-b8c7-b0872486306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe98aa91-86db-48be-b8c7-b0872486306b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ef8b20-9d65-4553-87bc-e6fcb3d1589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:02 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Volume 53a0768d-c587-47f4-af41-bac67eb7fcf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a0768d-c587-47f4-af41-bac67eb7fcf4', 'volume_size': 1} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:02 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198" returned: 0 in 1.167s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:02 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198 Jul 03 16:22:02 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:02 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a 1G" returned: 0 in 1.206s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:02 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a Jul 03 16:22:02 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:03 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e.0ab5713f-99bd-4cc4-82f1-c3089c355198" returned: 0 in 0.752s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "cinder-quobyte-0ab5713f-99bd-4cc4-82f1-c3089c355198" released by "_delete_snapshot" :: held 4.120s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "cinder-quobyte-5a2ec589-90d4-4baf-9356-c7706cf1474e" released by "delete_snapshot" :: held 4.152s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:03 devstack cinder-volume[86659]: WARNING cinder.quota [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1030569864 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1030569864, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:22:03 devstack cinder-volume[86659]: WARNING cinder.quota [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1030569864 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1030569864, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:22:03 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a" returned: 0 in 0.840s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:03 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a is being set with open permissions: ugo+rw Jul 03 16:22:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:03 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] Created reservations ['9d637aa2-e3d9-4e10-9e01-dba21c0e4ac2', '08b74872-8ba8-4e23-b25f-02f780d20bdb', '173a805c-8ffd-40b1-92bc-6c6b28fae998', '550810dc-e982-4dd2-a6c6-313a406d0b35'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:03 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a Jul 03 16:22:03 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-95af277d-e432-4136-8580-4c555e4459f6 tempest-GroupSnapshotsV319Test-1840974193 None] group_snapshot cda6e37a-0bd1-489b-a415-b0f65665e475: deleted successfully Jul 03 16:22:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Acquiring lock "cinder-quobyte-5a2ec589-90d4-4baf-9356-c7706cf1474e" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "cinder-quobyte-5a2ec589-90d4-4baf-9356-c7706cf1474e" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:04 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3775a6be-dcf7-45a4-b5e5-466a9d10df76]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:04 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e Jul 03 16:22:04 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:04 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a" returned: 0 in 0.817s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:04 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.info Jul 03 16:22:04 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:05 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e" returned: 0 in 0.995s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:05 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e Jul 03 16:22:05 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:05 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.info" returned: 0 in 0.847s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:05 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.info is being set with open permissions: ugo+rw Jul 03 16:22:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:05 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.info Jul 03 16:22:05 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:06 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5a2ec589-90d4-4baf-9356-c7706cf1474e" returned: 0 in 0.754s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "cinder-quobyte-5a2ec589-90d4-4baf-9356-c7706cf1474e" released by "delete_volume" :: held 1.853s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:06 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.info" returned: 0 in 0.724s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.598s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.423s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1521561415',display_name='tempest-VolumesGetTest-Volume-1789016776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a0768d-c587-47f4-af41-bac67eb7fcf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:03Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Creating volume 53a0768d-c587-47f4-af41-bac67eb7fcf4 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:22:06 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:06 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 1073741824 Jul 03 16:22:06 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:06 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4d291109-252b-46ab-aa6e-2ec7edbbe087 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Create snapshot completed successfully Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Created reservations ['c62b672e-2123-40a3-8b00-79a7a93b14a9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:06 devstack cinder-volume[86659]: WARNING cinder.quota [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1030569864 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1030569864, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Created reservations ['07081d16-5eff-454d-89e6-0851ff76eb67', '08a64d7b-8408-4069-925a-537a1dae153a', '84db7e97-5514-4cec-9971-f3bc710b0de0', '564bd2ee-056f-4186-a969-4ea5fe8165c9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:06 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:06 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:07 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 1073741824" returned: 0 in 1.298s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:07 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 Jul 03 16:22:07 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:07 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.384s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:07 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:07 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-52831d31-9843-4ea7-843f-3e7311f33e50 tempest-GroupSnapshotsV319Test-1840974193 None] Delete group completed successfully. Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Acquiring lock "cinder-36086eb8-88d8-4396-91a2-eea30d851c1a-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-36086eb8-88d8-4396-91a2-eea30d851c1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Acquiring lock "cinder-quobyte-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-quobyte-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Acquiring lock "cinder-quobyte-36086eb8-88d8-4396-91a2-eea30d851c1a" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-quobyte-36086eb8-88d8-4396-91a2-eea30d851c1a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Deleting offline snapshot 36086eb8-88d8-4396-91a2-eea30d851c1a of volume e6c954b1-cf73-4de0-bdd6-ea189fdfce4c {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] snapshot_file for this snap is: volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaeaca4-3b23-4069-b7cf-441bb3a3d8f5]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:08 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a Jul 03 16:22:08 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:08 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4" returned: 0 in 1.082s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] <== create_volume: return (2553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.556s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ef8b20-9d65-4553-87bc-e6fcb3d1589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a0768d-c587-47f4-af41-bac67eb7fcf4', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784a6854-f77e-4588-bcc5-cb0d1a82f4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:08 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Volume volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 (53a0768d-c587-47f4-af41-bac67eb7fcf4): created successfully Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784a6854-f77e-4588-bcc5-cb0d1a82f4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (1b66dcb5-fc0f-4dd7-8a9a-4f1263bdcc65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:08 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-5cf48a88-b0f2-4979-bdd6-ee4b2ab072c8 tempest-VolumesGetTest-1378786862 None] Created volume successfully. Jul 03 16:22:09 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a" returned: 0 in 1.027s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7f44b6-0c79-463d-99dc-8a513edd1bac]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:09 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c Jul 03 16:22:09 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-53a0768d-c587-47f4-af41-bac67eb7fcf4-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Lock "cinder-53a0768d-c587-47f4-af41-bac67eb7fcf4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-quobyte-53a0768d-c587-47f4-af41-bac67eb7fcf4" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-53a0768d-c587-47f4-af41-bac67eb7fcf4" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[21673034-accb-42ed-ab10-c63042eb6324]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:09 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 Jul 03 16:22:09 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:10 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" returned: 0 in 1.098s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:10 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a Jul 03 16:22:10 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:10 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4" returned: 0 in 0.943s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:10 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4 Jul 03 16:22:10 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:11 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-53a0768d-c587-47f4-af41-bac67eb7fcf4" returned: 0 in 0.748s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:11 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-53a0768d-c587-47f4-af41-bac67eb7fcf4" released by "delete_volume" :: held 1.755s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a" returned: 0 in 1.017s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:11 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a Jul 03 16:22:11 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Created reservations ['e2493b8a-cefc-4d79-b134-4b4b8254b0d6', 'c3fd2754-cb74-4b23-9345-b1e9b5a8d779', '729ae512-6aae-4d55-9714-2c31a8708d3d', '7be636ba-56e2-4417-865d-f7554494f086'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:11 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:11 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-1f468011-3d5d-4662-945a-c63525425634-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Lock "cinder-1f468011-3d5d-4662-945a-c63525425634-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-quobyte-1f468011-3d5d-4662-945a-c63525425634" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-1f468011-3d5d-4662-945a-c63525425634" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bddb43d-6c37-41d6-9e06-3f0e5c40f560]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:12 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c.36086eb8-88d8-4396-91a2-eea30d851c1a" returned: 0 in 0.820s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:12 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634 Jul 03 16:22:12 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-quobyte-36086eb8-88d8-4396-91a2-eea30d851c1a" released by "_delete_snapshot" :: held 4.129s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-quobyte-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" released by "delete_snapshot" :: held 4.165s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Created reservations ['5d975b56-761c-4d7a-904d-292a047121e5', '1ae8911e-9a18-42f8-9623-c6fcdf1b0a40', '6761b2c5-0eac-47a5-9619-c4cd40b22851', 'ce840b5d-bcef-40d4-ac45-f3a1cb8de08c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Delete snapshot completed successfully. Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b0f18d21-c59e-4e2a-ab98-8c3f6f873e10 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-36086eb8-88d8-4396-91a2-eea30d851c1a-delete_snapshot" released by "delete_snapshot" :: held 4.360s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:12 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.960s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Deleted volume successfully. Jul 03 16:22:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ed962b63-f25c-44b5-a652-a24fa43b5f0b tempest-VolumesGetTest-1378786862 None] Lock "cinder-53a0768d-c587-47f4-af41-bac67eb7fcf4-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:13 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634" returned: 0 in 0.945s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:13 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634 Jul 03 16:22:13 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Acquiring lock "cinder-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Acquiring lock "cinder-quobyte-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-quobyte-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc98ba06-4c29-454c-95e6-b34532461892]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:13 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1f468011-3d5d-4662-945a-c63525425634" returned: 0 in 0.689s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-1f468011-3d5d-4662-945a-c63525425634" released by "delete_volume" :: held 1.696s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Created reservations ['af5e9165-2820-4287-9e7f-2cb16c99bd0e', '88057b47-9ae9-40b4-9433-f08fa4a47b58', '30c43497-69de-4401-9af7-573f3c741a6a', 'de9e0575-8598-4e37-bfe9-d606efb8b230'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:13 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c Jul 03 16:22:13 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:13 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:13 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:14 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" returned: 0 in 1.020s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:14 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c Jul 03 16:22:14 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:14 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.911s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (f2c605ef-beba-4957-935b-1e56d483036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fc81ae-489b-4c44-a7e4-a6ae6abb14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Deleted volume successfully. Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fc81ae-489b-4c44-a7e4-a6ae6abb14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647093677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:15Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e77f90-5d01-4c8b-87e4-a2cde86784cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e77f90-5d01-4c8b-87e4-a2cde86784cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57576986-cde6-4ce9-9bea-54362f44c86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57576986-cde6-4ce9-9bea-54362f44c86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab', 'volume_name': 'volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7488788b-df7e-4cd1-bae9-d2ed356ed220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7488788b-df7e-4cd1-bae9-d2ed356ed220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efb76f9-fde7-4662-a2af-1835bb2a60d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:14 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Volume 568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab', 'volume_size': 1} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647093677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:15Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Creating volume 568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:22:14 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e77ed6-c36d-4f88-a36d-084cb831ffa5 tempest-VolumesGetTest-1378786862 None] Lock "cinder-1f468011-3d5d-4662-945a-c63525425634-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:14 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab 1073741824 Jul 03 16:22:14 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:15 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" returned: 0 in 0.976s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-quobyte-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c" released by "delete_volume" :: held 2.089s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:15 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Created reservations ['271ff2d0-01a0-4908-b98a-d3158dc50cf3', '2081fecd-3d64-4f81-87a7-1e648db9a611', '5b0ce3c2-7d4f-47c9-96a6-ea0b120a7a39', 'b09d686b-e407-432b-ac08-f1d70a863252'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:15 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:15 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:16 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab 1073741824" returned: 0 in 1.423s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:16 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab Jul 03 16:22:16 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:17 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.369s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:17 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Deleted volume successfully. Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b07e0cdc-a34b-4789-a638-344e847d3c91 tempest-VolumeSnapshotQuotasNegativeTestJSON-758659677 None] Lock "cinder-e6c954b1-cf73-4de0-bdd6-ea189fdfce4c-delete_volume" released by "delete_volume" :: held 3.800s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:17 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" returned: 0 in 1.002s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] <== create_volume: return (2495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.498s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efb76f9-fde7-4662-a2af-1835bb2a60d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e5c599-93b4-4ee4-aa97-084f81b22953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:17 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Volume volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab (568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab): created successfully Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e5c599-93b4-4ee4-aa97-084f81b22953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (f2c605ef-beba-4957-935b-1e56d483036c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:17 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c7e05ddd-49a5-4911-a5b7-68ecc73a37af tempest-VolumesGetTest-1378786862 None] Created volume successfully. Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=128,cinder:UPDATE=142,cinder:INSERT=35,cinder:DELETE=8 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=123,cinder:UPDATE=146,cinder:INSERT=32,cinder:DELETE=10 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (04d2da61-ee25-4efd-8bbe-a746dc1802e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ce75db-68d5-4f25-90ea-dd1837d525e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ce75db-68d5-4f25-90ea-dd1837d525e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-4284909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d19709-0901-4247-995f-58c33fd8b537,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:19Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b12bb6-5db8-4cd4-b5c5-b01bc04f0cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b12bb6-5db8-4cd4-b5c5-b01bc04f0cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f188048-6e24-4e94-9a09-48e75f23e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f188048-6e24-4e94-9a09-48e75f23e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '48d19709-0901-4247-995f-58c33fd8b537', 'volume_name': 'volume-48d19709-0901-4247-995f-58c33fd8b537', 'volume_size': 1, 'source_volid': '568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab', 'source_volstatus': 'available'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454a06af-0b2d-4632-aa46-0eb4fbca9ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454a06af-0b2d-4632-aa46-0eb4fbca9ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fcc5da-3017-4f70-a80e-74fd8a0cc2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Volume 48d19709-0901-4247-995f-58c33fd8b537: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-48d19709-0901-4247-995f-58c33fd8b537', 'volume_size': 1, 'source_volid': '568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab', 'source_volstatus': 'available'} Jul 03 16:22:18 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:18 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:19 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Cloning volume 568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab to volume 48d19709-0901-4247-995f-58c33fd8b537 Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Creating offline snapshot 18c85bd9-6a7b-4aaf-9dec-899c70f93e31 of volume 568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2919ca8a-bd4a-4a5a-87c0-43d33a4bdd91]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:19 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab Jul 03 16:22:19 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Flow 'volume_create_manager' (08a26c57-651f-44a6-8326-22be9dca9418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3601074-c7b7-432c-a17e-969b319f7aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3601074-c7b7-432c-a17e-969b319f7aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2028650950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60d244b-c4fa-482d-9bb2-e31bb61ae354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692b2a15a294402b075e614292d1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:20Z,use_quota=True,user_id='1e4ae87af9a54a388fe862a5bdc7b4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7a639c-d88d-4619-9350-6129de5f2338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7a639c-d88d-4619-9350-6129de5f2338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8c335f-68a5-4fb9-8383-bea3460e77c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8c335f-68a5-4fb9-8383-bea3460e77c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60d244b-c4fa-482d-9bb2-e31bb61ae354', 'volume_name': 'volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476cec8c-bbe7-4875-9e2b-fa4bd2f30617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476cec8c-bbe7-4875-9e2b-fa4bd2f30617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2a4732-f066-4568-b1fc-157382f8962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:19 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Volume a60d244b-c4fa-482d-9bb2-e31bb61ae354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354', 'volume_size': 1} Jul 03 16:22:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:20 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.247s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:22:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:22:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:22:20 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" returned: 0 in 1.392s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:20 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 1G Jul 03 16:22:20 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:21 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 1G" returned: 0 in 0.969s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:21 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 Jul 03 16:22:21 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:22 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31" returned: 0 in 0.842s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:22 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 is being set with open permissions: ugo+rw Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:22 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 Jul 03 16:22:22 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Flow 'volume_create_manager' (f7bf0cec-f56e-483c-a903-18c2576b9a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b01b11-6e54-437e-aede-44edf3cfb6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b01b11-6e54-437e-aede-44edf3cfb6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1770553569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95aea02d-df8d-4b14-ba3e-253744992ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599485bcdbe3442eb53f27f491f2a8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:23Z,use_quota=True,user_id='b44196d5c7be4b63b00d472d02e54786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38caa93-cae5-43c9-ac63-2cc6c7058b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38caa93-cae5-43c9-ac63-2cc6c7058b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bd5401-4037-4f57-9e78-2befe00ba392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bd5401-4037-4f57-9e78-2befe00ba392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95aea02d-df8d-4b14-ba3e-253744992ede', 'volume_name': 'volume-95aea02d-df8d-4b14-ba3e-253744992ede', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aff5b37-594f-49b3-83db-ca96ef4509d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aff5b37-594f-49b3-83db-ca96ef4509d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e71054-e4b4-4c3b-aff2-4f705d1273ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:22 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Volume 95aea02d-df8d-4b14-ba3e-253744992ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95aea02d-df8d-4b14-ba3e-253744992ede', 'volume_size': 1} Jul 03 16:22:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:23 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31" returned: 0 in 0.754s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:23 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.info Jul 03 16:22:23 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:23 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.info" returned: 0 in 0.743s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:23 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.info is being set with open permissions: ugo+rw Jul 03 16:22:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:23 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.info Jul 03 16:22:23 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:24 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.info" returned: 0 in 0.707s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-quobyte-48d19709-0901-4247-995f-58c33fd8b537" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-48d19709-0901-4247-995f-58c33fd8b537" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] snapshot: 18c85bd9-6a7b-4aaf-9dec-899c70f93e31, volume: 48d19709-0901-4247-995f-58c33fd8b537, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac543f-c05e-48af-a977-b07a461a6b5d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:24 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 Jul 03 16:22:24 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:25 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31" returned: 0 in 0.911s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:22:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:22:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:22:25 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba1591b-26f7-49f1-8e78-e5028f3c4637]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:25 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab Jul 03 16:22:25 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:26 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" returned: 0 in 0.909s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:26 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:22:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:26 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 Jul 03 16:22:26 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:32 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537" returned: 0 in 5.703s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:32 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a1cd83-a00a-44c4-9bf1-1a0239e00e56]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:32 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab Jul 03 16:22:32 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:33 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:22:33 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=2 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:22:33 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" returned: 0 in 1.087s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:33 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:22:33 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Converted 1024.00 MB image at 179.50 MB/s Jul 03 16:22:33 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 is being set with open permissions: ugo+rw Jul 03 16:22:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:33 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 Jul 03 16:22:33 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:34 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537" returned: 0 in 0.838s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-48d19709-0901-4247-995f-58c33fd8b537" released by "_copy_volume_from_snapshot" :: held 9.577s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-quobyte-18c85bd9-6a7b-4aaf-9dec-899c70f93e31" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-18c85bd9-6a7b-4aaf-9dec-899c70f93e31" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Deleting offline snapshot 18c85bd9-6a7b-4aaf-9dec-899c70f93e31 of volume 568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:22:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] snapshot_file for this snap is: volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:22:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0467dd-f83d-4fb9-a4a8-17fabf487f5b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:34 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 Jul 03 16:22:34 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:35 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31" returned: 0 in 0.856s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:22:35 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe56ff5d-f36e-4b6b-90f4-d4801552f91d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:35 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab Jul 03 16:22:35 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:35 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" returned: 0 in 0.851s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:35 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 Jul 03 16:22:35 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Flow 'volume_create_manager' (ba259dae-50bf-4901-81f1-cf1b3f2168ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae91679-40d6-4eff-9fb4-62b8348c2898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae91679-40d6-4eff-9fb4-62b8348c2898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1821575996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0db2e12-4fa6-4f94-b30e-465e26174abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39adcd0abac409a92e014764766cce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:37Z,use_quota=True,user_id='9ffc922945a64ce6a4318c56fcb35cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33aa2130-ead9-437c-ac46-08777c342ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33aa2130-ead9-437c-ac46-08777c342ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dededceb-ed22-4193-8346-9d76fc6e1e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG cinder.image.glance [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Creating Keystone auth plugin from conf {{(pid=86659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 16:22:36 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31" returned: 0 in 0.869s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:36 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31 Jul 03 16:22:36 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dededceb-ed22-4193-8346-9d76fc6e1e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0db2e12-4fa6-4f94-b30e-465e26174abf', 'volume_name': 'volume-c0db2e12-4fa6-4f94-b30e-465e26174abf', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257f3af7-4cd2-4914-90bb-22a745cdb727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257f3af7-4cd2-4914-90bb-22a745cdb727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200e0782-3731-454c-892b-206c1f2b4582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Volume c0db2e12-4fa6-4f94-b30e-465e26174abf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0db2e12-4fa6-4f94-b30e-465e26174abf', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Trying to clone c0db2e12-4fa6-4f94-b30e-465e26174abf from image a5edd4aa-3f97-4644-9685-8001dd3a8cdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]). {{(pid=86659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 16:22:37 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Image download 20.69 MB at 20.69 MB/s Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab5fe1b-47a4-4eec-a13f-cfa7d9a16f44]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:37 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab.18c85bd9-6a7b-4aaf-9dec-899c70f93e31" returned: 0 in 0.722s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-18c85bd9-6a7b-4aaf-9dec-899c70f93e31" released by "_delete_snapshot" :: held 3.408s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:37 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD Jul 03 16:22:37 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.624s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.687s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2028650950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60d244b-c4fa-482d-9bb2-e31bb61ae354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692b2a15a294402b075e614292d1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:20Z,use_quota=True,user_id='1e4ae87af9a54a388fe862a5bdc7b4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Creating volume a60d244b-c4fa-482d-9bb2-e31bb61ae354 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:22:37 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fcc5da-3017-4f70-a80e-74fd8a0cc2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d19709-0901-4247-995f-58c33fd8b537', 'volume_size': 1, 'source_volid': '568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab', 'source_volstatus': 'available'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9dbf84-ea5e-4653-83ed-87a4b9516204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:37 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 1073741824 Jul 03 16:22:37 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Volume volume-48d19709-0901-4247-995f-58c33fd8b537 (48d19709-0901-4247-995f-58c33fd8b537): created successfully Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9dbf84-ea5e-4653-83ed-87a4b9516204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (04d2da61-ee25-4efd-8bbe-a746dc1802e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-49ed70b0-1ecc-4cd5-a5d7-dae715b90c06 tempest-VolumesGetTest-1378786862 None] Created volume successfully. Jul 03 16:22:38 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:38 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Temporary image a5edd4aa-3f97-4644-9685-8001dd3a8cdd is fetched for user 9ffc922945a64ce6a4318c56fcb35cea. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 16:22:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b3c56-a6f5-44d1-b8fc-f762cdd40b69]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:38 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD Jul 03 16:22:38 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:38 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 1073741824" returned: 0 in 0.929s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:38 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 Jul 03 16:22:38 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:39 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:22:39 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (3df5a6a1-e12e-40b6-b3c9-26c1012ed60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937b5ac3-4b25-483c-b880-2d2a6ca65290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354" returned: 0 in 0.819s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.745s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1770553569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95aea02d-df8d-4b14-ba3e-253744992ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599485bcdbe3442eb53f27f491f2a8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:23Z,use_quota=True,user_id='b44196d5c7be4b63b00d472d02e54786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Creating volume 95aea02d-df8d-4b14-ba3e-253744992ede {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:22:39 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937b5ac3-4b25-483c-b880-2d2a6ca65290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1779223672',display_name='tempest-VolumesGetTest-Volume-1395318245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10844543-f562-4483-be6a-c3f604361459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:39Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b6c65b-7c01-4ffc-a033-2090dfeb7be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:39 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede 1073741824 Jul 03 16:22:39 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b6c65b-7c01-4ffc-a033-2090dfeb7be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7e1d0d-5ddb-4d90-a9f9-ba5c5f30d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7e1d0d-5ddb-4d90-a9f9-ba5c5f30d251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10844543-f562-4483-be6a-c3f604361459', 'volume_name': 'volume-10844543-f562-4483-be6a-c3f604361459', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c8643c-0460-4def-bcd3-6667e468f132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c8643c-0460-4def-bcd3-6667e468f132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a123702-9bfd-422f-95a5-022662affb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:39 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Volume 10844543-f562-4483-be6a-c3f604361459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10844543-f562-4483-be6a-c3f604361459', 'volume_size': 1} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2a4732-f066-4568-b1fc-157382f8962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9758a698-70b8-4327-818d-1a19ea4d7c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:39 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Volume volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 (a60d244b-c4fa-482d-9bb2-e31bb61ae354): created successfully Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9758a698-70b8-4327-818d-1a19ea4d7c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Flow 'volume_create_manager' (08a26c57-651f-44a6-8326-22be9dca9418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-04dc2cd0-9381-4292-8298-aaa7f88f6eb8 tempest-AttachVolumeNegativeTest-2091901602 None] Created volume successfully. Jul 03 16:22:40 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede 1073741824" returned: 0 in 0.984s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:40 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede Jul 03 16:22:40 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:41 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede" returned: 0 in 0.733s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1821575996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0db2e12-4fa6-4f94-b30e-465e26174abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39adcd0abac409a92e014764766cce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:37Z,use_quota=True,user_id='9ffc922945a64ce6a4318c56fcb35cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Creating volume c0db2e12-4fa6-4f94-b30e-465e26174abf {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:22:41 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:41 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf 1073741824 Jul 03 16:22:41 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e71054-e4b4-4c3b-aff2-4f705d1273ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95aea02d-df8d-4b14-ba3e-253744992ede', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7526578-2a5b-4fac-89e7-db515b7c4cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:41 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Volume volume-95aea02d-df8d-4b14-ba3e-253744992ede (95aea02d-df8d-4b14-ba3e-253744992ede): created successfully Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7526578-2a5b-4fac-89e7-db515b7c4cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Flow 'volume_create_manager' (f7bf0cec-f56e-483c-a903-18c2576b9a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:41 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a5a51996-aa71-4566-90bb-2a7e3cf77817 tempest-VolumesServicesTestJSON-2076079132 None] Created volume successfully. Jul 03 16:22:42 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf 1073741824" returned: 0 in 0.933s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:42 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf Jul 03 16:22:42 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Acquiring lock "cinder-95aea02d-df8d-4b14-ba3e-253744992ede-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Lock "cinder-95aea02d-df8d-4b14-ba3e-253744992ede-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Acquiring lock "cinder-quobyte-95aea02d-df8d-4b14-ba3e-253744992ede" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Lock "cinder-quobyte-95aea02d-df8d-4b14-ba3e-253744992ede" acquired by "delete_volume" :: waited 0.015s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a63b05-2a17-49c0-830a-3ab8071bce2a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:42 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede Jul 03 16:22:42 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:42 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf" returned: 0 in 0.747s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.433s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1779223672',display_name='tempest-VolumesGetTest-Volume-1395318245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10844543-f562-4483-be6a-c3f604361459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:39Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Creating volume 10844543-f562-4483-be6a-c3f604361459 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:22:42 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:22:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:43 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459 1073741824 Jul 03 16:22:43 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Attempting download of a5edd4aa-3f97-4644-9685-8001dd3a8cdd ((None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}])) to volume c0db2e12-4fa6-4f94-b30e-465e26174abf. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 16:22:43 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:43 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b92c38-4599-42a6-8f48-e0ae401c3e9e]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_5gy11m93 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:43 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_5gy11m93 Jul 03 16:22:43 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:43 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede" returned: 0 in 0.990s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:43 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede Jul 03 16:22:43 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:44 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_5gy11m93" returned: 0 in 1.025s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_5gy11m93 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:44 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-ff71a19f-e4b5-40fc-9461-ebad664b680b req-f86a8f00-bac9-40f7-a511-1e8f74cf355b tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459 1073741824" returned: 0 in 1.278s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:44 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_5gy11m93 Jul 03 16:22:44 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:44 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459 Jul 03 16:22:44 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:44 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-95aea02d-df8d-4b14-ba3e-253744992ede" returned: 0 in 0.794s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Lock "cinder-quobyte-95aea02d-df8d-4b14-ba3e-253744992ede" released by "delete_volume" :: held 1.846s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Created reservations ['4e4778bd-7747-4746-b6b9-956567757ec2', '35a5f4ae-852b-45f1-811f-b88aca9c0670', 'd2f805c8-c6bd-4da4-9e86-5fb101533431', '06df845c-7202-404d-8fc0-6d25e59a0954'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:44 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:44 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:45 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_5gy11m93" returned: 1 in 0.841s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_5gy11m93' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9220e92f-5c95-4d4e-8357-5217517c3cfb]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:45 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459" returned: 0 in 0.819s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-ff71a19f-e4b5-40fc-9461-ebad664b680b req-f86a8f00-bac9-40f7-a511-1e8f74cf355b tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.859s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:45 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD Jul 03 16:22:45 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a123702-9bfd-422f-95a5-022662affb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10844543-f562-4483-be6a-c3f604361459', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c190c3-26c1-47b7-9673-75144a2edbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[62193424-aec1-48b4-9e3a-7c7feb4ab309]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-ff71a19f-e4b5-40fc-9461-ebad664b680b req-f86a8f00-bac9-40f7-a511-1e8f74cf355b tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:45 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Volume volume-10844543-f562-4483-be6a-c3f604361459 (10844543-f562-4483-be6a-c3f604361459): created successfully Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c190c3-26c1-47b7-9673-75144a2edbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (3df5a6a1-e12e-40b6-b3c9-26c1012ed60c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1ca18766-0ccb-48d4-8446-f937e404efd8 tempest-VolumesGetTest-1378786862 None] Created volume successfully. Jul 03 16:22:45 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 Jul 03 16:22:45 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:45 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.921s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Deleted volume successfully. Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dc6ae447-9784-4ee8-8dd2-08074b744b10 tempest-VolumesServicesTestJSON-2076079132 None] Lock "cinder-95aea02d-df8d-4b14-ba3e-253744992ede-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-10844543-f562-4483-be6a-c3f604361459-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Lock "cinder-10844543-f562-4483-be6a-c3f604361459-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:46 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD" returned: 0 in 0.992s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] a5edd4aa-3f97-4644-9685-8001dd3a8cdd was qcow2, converting to raw {{(pid=86659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:46 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf Jul 03 16:22:46 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-quobyte-10844543-f562-4483-be6a-c3f604361459" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-10844543-f562-4483-be6a-c3f604361459" acquired by "delete_volume" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[35241e57-7a28-4a97-847a-fdf611e825bc]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:46 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459 Jul 03 16:22:46 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-ff71a19f-e4b5-40fc-9461-ebad664b680b req-f86a8f00-bac9-40f7-a511-1e8f74cf355b tempest-AttachVolumeNegativeTest-2091901602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354" returned: 0 in 1.239s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-ff71a19f-e4b5-40fc-9461-ebad664b680b req-f86a8f00-bac9-40f7-a511-1e8f74cf355b tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.305s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:46 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-ff71a19f-e4b5-40fc-9461-ebad664b680b req-f86a8f00-bac9-40f7-a511-1e8f74cf355b tempest-AttachVolumeNegativeTest-2091901602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24ac7a51-4f39-44bb-a635-77d383536934', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:22:46 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-ff71a19f-e4b5-40fc-9461-ebad664b680b req-f86a8f00-bac9-40f7-a511-1e8f74cf355b tempest-AttachVolumeNegativeTest-2091901602 None] attachment_update completed successfully. Jul 03 16:22:47 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459" returned: 0 in 1.256s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:47 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459 Jul 03 16:22:47 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:48 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10844543-f562-4483-be6a-c3f604361459" returned: 0 in 0.997s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-10844543-f562-4483-be6a-c3f604361459" released by "delete_volume" :: held 2.325s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Created reservations ['68cbbd25-00a3-4c92-9d7e-3bd38403cf82', '036bf00d-55c4-4ba0-a21c-0125b6bc3877', '35fcf886-3494-46fe-8477-9965470e3e3c', '578a2fbd-3d59-4308-b49e-461258eafb93'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:48 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:48 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:48 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf" returned: 0 in 2.692s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_020_313mdevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:22:48 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Converted 112.00 MB image at 41.58 MB/s Jul 03 16:22:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:48 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf 1G Jul 03 16:22:48 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:49 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.825s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Deleted volume successfully. Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-48d19709-0901-4247-995f-58c33fd8b537-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9ca7fce4-267e-4c7e-b1bd-eaa2da271d18 tempest-VolumesGetTest-1378786862 None] Lock "cinder-10844543-f562-4483-be6a-c3f604361459-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Lock "cinder-48d19709-0901-4247-995f-58c33fd8b537-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-quobyte-48d19709-0901-4247-995f-58c33fd8b537" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-48d19709-0901-4247-995f-58c33fd8b537" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43f41b6-37bf-4264-a12f-9873d02f12b4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:49 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf 1G" returned: 0 in 0.948s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefadf7e-b97e-44de-a423-5c3542d182e0]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:49 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 Jul 03 16:22:49 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:49 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf Jul 03 16:22:49 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:50 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537" returned: 0 in 0.911s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:50 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf" returned: 0 in 0.861s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:50 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537 Jul 03 16:22:50 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:50 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf Jul 03 16:22:50 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:51 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-48d19709-0901-4247-995f-58c33fd8b537" returned: 0 in 0.818s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-48d19709-0901-4247-995f-58c33fd8b537" released by "delete_volume" :: held 1.793s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Created reservations ['c62461b6-e8f7-4a1e-a4fd-5787de3593a6', '742321db-68b0-428a-afcc-87c5285de91c', '74a63244-d0cf-44f3-b0c4-dd3bfef4d605', '488cee0b-160c-4b7d-945b-a30ad0ddf2dd'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:51 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf" returned: 1 in 1.001s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Downloaded image a5edd4aa-3f97-4644-9685-8001dd3a8cdd ((None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}])) to volume c0db2e12-4fa6-4f94-b30e-465e26174abf successfully. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Temporary image a5edd4aa-3f97-4644-9685-8001dd3a8cdd for user 9ffc922945a64ce6a4318c56fcb35cea is deleted. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Marking volume c0db2e12-4fa6-4f94-b30e-465e26174abf as bootable. {{(pid=86659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 16:22:51 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:51 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Copying metadata from image a5edd4aa-3f97-4644-9685-8001dd3a8cdd to c0db2e12-4fa6-4f94-b30e-465e26174abf. {{(pid=86659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Creating volume glance metadata for volume c0db2e12-4fa6-4f94-b30e-465e26174abf backed by image a5edd4aa-3f97-4644-9685-8001dd3a8cdd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200e0782-3731-454c-892b-206c1f2b4582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0db2e12-4fa6-4f94-b30e-465e26174abf', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f133f2-ce3a-4fb4-b1a0-522847d4c8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Volume volume-c0db2e12-4fa6-4f94-b30e-465e26174abf (c0db2e12-4fa6-4f94-b30e-465e26174abf): created successfully Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f133f2-ce3a-4fb4-b1a0-522847d4c8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Flow 'volume_create_manager' (ba259dae-50bf-4901-81f1-cf1b3f2168ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a280c38a-33c5-4db7-8a68-f72815f169ae tempest-VolumesImageMetadata-814490452 None] Created volume successfully. Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Lock "cinder-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-quobyte-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[75765cb2-fd7d-4bf5-a564-979ce0e90061]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:52 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab Jul 03 16:22:52 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:52 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.011s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:52 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Deleted volume successfully. Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6fc5fe8f-308e-492e-aa55-969ffdfe1044 tempest-VolumesGetTest-1378786862 None] Lock "cinder-48d19709-0901-4247-995f-58c33fd8b537-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Acquiring lock "cinder-c0db2e12-4fa6-4f94-b30e-465e26174abf-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Lock "cinder-c0db2e12-4fa6-4f94-b30e-465e26174abf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Acquiring lock "cinder-quobyte-c0db2e12-4fa6-4f94-b30e-465e26174abf" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Lock "cinder-quobyte-c0db2e12-4fa6-4f94-b30e-465e26174abf" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dcabde-4d86-4014-b1e2-d9f74b7b7fbc]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:22:53 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf Jul 03 16:22:53 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Flow 'volume_create_manager' (4fc7ef2f-2528-432a-a932-cf13f32edaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc37030-c00e-40e7-9e3e-a009a6d12710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc37030-c00e-40e7-9e3e-a009a6d12710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1472694305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a240ad-3286-4f7e-bfd9-afc810e2a8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ae132784064ceb9bfdd934a146eba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:53Z,use_quota=True,user_id='f95dffe8a9db462fa00e7a52393f15a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(734e3826-ca83-470c-9537-083fc6d6cdfc),volume_type_id=734e3826-ca83-470c-9537-083fc6d6cdfc)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511a4443-cd6b-4f54-a8e7-8315eec45a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511a4443-cd6b-4f54-a8e7-8315eec45a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e32a658-3c08-4560-8171-1cdf65630b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e32a658-3c08-4560-8171-1cdf65630b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a240ad-3286-4f7e-bfd9-afc810e2a8ca', 'volume_name': 'volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6f1ba4-8600-4a59-afd4-9bc796c56a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6f1ba4-8600-4a59-afd4-9bc796c56a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9b00e8-f4b1-4c43-80cc-7d0b048c0987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:53 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Volume e3a240ad-3286-4f7e-bfd9-afc810e2a8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca', 'volume_size': 1} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1472694305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a240ad-3286-4f7e-bfd9-afc810e2a8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ae132784064ceb9bfdd934a146eba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:53Z,use_quota=True,user_id='f95dffe8a9db462fa00e7a52393f15a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(734e3826-ca83-470c-9537-083fc6d6cdfc),volume_type_id=734e3826-ca83-470c-9537-083fc6d6cdfc)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Creating volume e3a240ad-3286-4f7e-bfd9-afc810e2a8ca {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:22:53 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:53 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca 1073741824 Jul 03 16:22:53 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:53 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" returned: 0 in 1.004s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:53 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab Jul 03 16:22:53 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-19705c45-8ada-4f2b-a78c-ce37d41cabd7 req-58b1754d-5f16-4290-8685-c8fa266fd77b tempest-AttachVolumeNegativeTest-2091901602 None] Terminate volume connection completed successfully. Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-19705c45-8ada-4f2b-a78c-ce37d41cabd7 req-58b1754d-5f16-4290-8685-c8fa266fd77b tempest-AttachVolumeNegativeTest-2091901602 None] Deleting attachment 24ac7a51-4f39-44bb-a635-77d383536934. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:22:53 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf" returned: 0 in 1.013s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:54 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf Jul 03 16:22:54 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:54 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:54 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca 1073741824" returned: 0 in 0.988s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" returned: 0 in 0.871s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab" released by "delete_volume" :: held 1.941s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:54 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca Jul 03 16:22:54 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Created reservations ['848ccf46-6283-4370-8617-7175f9ac3c39', 'ed69306d-66be-4e83-9552-d06dc7833745', '77cda548-27b0-4373-81ea-e3aed5be0a7a', '0e255619-30db-4dcc-88ac-ec686d8ff898'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:54 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:54 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:54 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf" returned: 1 in 0.964s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:22:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:54 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf Jul 03 16:22:54 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:55 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca" returned: 0 in 0.975s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9b00e8-f4b1-4c43-80cc-7d0b048c0987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb73e169-a568-4ef5-b8f2-dd00d72ea76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:55 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.870s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:55 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Deleted volume successfully. Jul 03 16:22:55 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Volume volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca (e3a240ad-3286-4f7e-bfd9-afc810e2a8ca): created successfully Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb73e169-a568-4ef5-b8f2-dd00d72ea76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Flow 'volume_create_manager' (4fc7ef2f-2528-432a-a932-cf13f32edaf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-61d09756-0f64-4cad-8c1a-480b22015996 tempest-VolumesGetTest-1378786862 None] Lock "cinder-568b9f29-dd8c-4d16-b4f6-c3bd074bd9ab-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:55 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-454bfcff-366c-4555-80a9-0d328f201ef4 tempest-VolumeTypesAccessTest-311825604 None] Created volume successfully. Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (c4ba96ef-8c45-4d33-8a03-924bef47b26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937a7c08-135f-404f-9880-822b36c07451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937a7c08-135f-404f-9880-822b36c07451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1954069167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d85832a-40f3-46af-8c2c-5becdd2c57d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:55Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a55b1d5-2c21-44ce-8f7c-317f2d9e2a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a55b1d5-2c21-44ce-8f7c-317f2d9e2a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243ad941-a425-4e3a-88af-7d768433f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.image.glance [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Creating Keystone auth plugin from conf {{(pid=86659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 16:22:55 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c0db2e12-4fa6-4f94-b30e-465e26174abf" returned: 0 in 0.913s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Lock "cinder-quobyte-c0db2e12-4fa6-4f94-b30e-465e26174abf" released by "delete_volume" :: held 3.014s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Created reservations ['1ec8f081-e40b-4c1e-b953-86358e230b20', '71c993b1-006c-4868-be51-2d91a215ad3c', '58c4529b-515c-4dda-a175-b0ba574db3f6', '5be9aedf-fdd2-4168-abb3-67a9ff30b837'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243ad941-a425-4e3a-88af-7d768433f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d85832a-40f3-46af-8c2c-5becdd2c57d6', 'volume_name': 'volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86280957-3492-4e4a-8b31-a60f3360440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86280957-3492-4e4a-8b31-a60f3360440e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe3d317-5408-40c6-9a20-5b571eb3ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:22:55 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Volume 7d85832a-40f3-46af-8c2c-5becdd2c57d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 16:22:55 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Trying to clone 7d85832a-40f3-46af-8c2c-5becdd2c57d6 from image a5edd4aa-3f97-4644-9685-8001dd3a8cdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]). {{(pid=86659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:56 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:56 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Acquiring lock "cinder-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 16:22:56 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Image download 20.69 MB at 20.69 MB/s Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Lock "cinder-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Acquiring lock "cinder-quobyte-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcc59ff-d388-4ddd-82a9-9b954908bc23]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Lock "cinder-quobyte-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8255ee31-f995-4b66-bbf7-063000082986]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:56 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD Jul 03 16:22:56 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:56 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca Jul 03 16:22:56 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:57 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.019s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:57 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:22:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Deleted volume successfully. Jul 03 16:22:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-193ee5a9-d5ac-4fa5-9176-03028e342aab tempest-VolumesImageMetadata-814490452 None] Lock "cinder-c0db2e12-4fa6-4f94-b30e-465e26174abf-delete_volume" released by "delete_volume" :: held 4.439s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:57 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD" returned: 0 in 1.281s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:57 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Temporary image a5edd4aa-3f97-4644-9685-8001dd3a8cdd is fetched for user 35ec0efb55ce42e2a236d17ec32ff5d3. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 16:22:58 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b868109f-4950-4bec-941c-0191606e4aef]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:22:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:58 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca" returned: 0 in 1.545s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:58 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca Jul 03 16:22:58 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:58 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD Jul 03 16:22:58 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:59 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca" returned: 0 in 0.909s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:59 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD" returned: 0 in 1.129s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1954069167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d85832a-40f3-46af-8c2c-5becdd2c57d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:22:55Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Creating volume 7d85832a-40f3-46af-8c2c-5becdd2c57d6 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:22:59 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Lock "cinder-quobyte-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca" released by "delete_volume" :: held 2.577s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:22:59 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 1073741824 Jul 03 16:22:59 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:22:59 devstack cinder-volume[86659]: WARNING cinder.quota [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-995651173 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-995651173, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:22:59 devstack cinder-volume[86659]: WARNING cinder.quota [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-995651173 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-995651173, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Created reservations ['9d1abe2f-0502-4bb4-b888-1bda7b6f68e0', 'c4d49754-6fd5-43bc-8438-6b888b326dd3', '27547136-1a66-452b-9818-cd83a2df1167', '55fa423c-5717-4ca4-9dad-f0fdb84cc70e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:22:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:22:59 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:22:59 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:00 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.149s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:00 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:23:00 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Deleted volume successfully. Jul 03 16:23:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-616a135a-4a0a-4e6d-a391-7313d6a9c796 tempest-VolumeTypesAccessTest-311825604 None] Lock "cinder-e3a240ad-3286-4f7e-bfd9-afc810e2a8ca-delete_volume" released by "delete_volume" :: held 4.116s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:00 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 1073741824" returned: 0 in 1.547s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:00 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 Jul 03 16:23:00 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Flow 'volume_create_manager' (a1af008a-7694-405b-8877-31134a8b88a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31455129-4c01-4415-8da1-0f9ad0cc72cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31455129-4c01-4415-8da1-0f9ad0cc72cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-208555939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02bdd7d4-5a77-4fe4-82fd-34d90c63f87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1720ee9ffd104b79aa20f2ec463c9e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:23:01Z,use_quota=True,user_id='1315389d63734e06906aa8bffa492c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29865c2e-73d6-4f49-ad7a-f727303d6eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29865c2e-73d6-4f49-ad7a-f727303d6eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c93cb23-35be-4a4a-bd62-d01f5272e66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c93cb23-35be-4a4a-bd62-d01f5272e66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02bdd7d4-5a77-4fe4-82fd-34d90c63f87f', 'volume_name': 'volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d528b7c-f3b9-4470-8dc6-8666bdee52d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d528b7c-f3b9-4470-8dc6-8666bdee52d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43874789-4f3f-4d1b-9437-2ace9f4d5471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:01 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Volume 02bdd7d4-5a77-4fe4-82fd-34d90c63f87f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f', 'volume_size': 1} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:01 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6" returned: 0 in 0.782s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.263s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-208555939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02bdd7d4-5a77-4fe4-82fd-34d90c63f87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1720ee9ffd104b79aa20f2ec463c9e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:23:01Z,use_quota=True,user_id='1315389d63734e06906aa8bffa492c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Creating volume 02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:23:01 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:01 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f 1073741824 Jul 03 16:23:01 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Attempting download of a5edd4aa-3f97-4644-9685-8001dd3a8cdd ((None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}])) to volume 7d85832a-40f3-46af-8c2c-5becdd2c57d6. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92ffdf7-32ad-453c-8533-289063680345]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_mxzpa6kl {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:01 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_mxzpa6kl Jul 03 16:23:01 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:02 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_mxzpa6kl" returned: 0 in 0.956s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_mxzpa6kl {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:02 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f 1073741824" returned: 0 in 1.175s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:02 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_mxzpa6kl Jul 03 16:23:02 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:02 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f Jul 03 16:23:02 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:03 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_mxzpa6kl" returned: 1 in 1.056s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_mxzpa6kl' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a967ed2-91ae-49a9-9532-fef44674a4ba]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:03 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" returned: 0 in 0.910s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43874789-4f3f-4d1b-9437-2ace9f4d5471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811f6228-ffc5-4858-b81d-80ecaccc6f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:03 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Volume volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f (02bdd7d4-5a77-4fe4-82fd-34d90c63f87f): created successfully Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811f6228-ffc5-4858-b81d-80ecaccc6f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Flow 'volume_create_manager' (a1af008a-7694-405b-8877-31134a8b88a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:23:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3fd05229-5f6c-4dc5-b0e8-2d61f54bb2e7 tempest-VolumesDeleteCascade-274439013 None] Created volume successfully. Jul 03 16:23:03 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD Jul 03 16:23:03 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:04 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD" returned: 0 in 0.869s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:04 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] a5edd4aa-3f97-4644-9685-8001dd3a8cdd was qcow2, converting to raw {{(pid=86659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 16:23:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:04 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 Jul 03 16:23:04 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Creating offline snapshot 8e73959e-ff1d-4cfb-b935-e0bf7b904929 of volume 02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:23:04 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e12c75d-4d8d-432f-91ab-5cc73e3ef6a4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:04 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f Jul 03 16:23:04 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:05 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" returned: 0 in 1.084s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:05 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 1G Jul 03 16:23:05 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:06 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 1G" returned: 0 in 1.191s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:07 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 Jul 03 16:23:07 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:07 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6" returned: 0 in 2.921s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:07 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_aqwu6totdevstack@QuobyteHD, size 112.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:23:07 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Converted 112.00 MB image at 38.33 MB/s Jul 03 16:23:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:07 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 1G Jul 03 16:23:07 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:08 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929" returned: 0 in 1.018s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:08 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 is being set with open permissions: ugo+rw Jul 03 16:23:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:08 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 Jul 03 16:23:08 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:08 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 1G" returned: 0 in 0.979s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:08 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1290e1d1-b760-4595-965f-35cf4ea6f80b]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:08 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 Jul 03 16:23:08 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:09 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929" returned: 0 in 1.001s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:09 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.info Jul 03 16:23:09 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:09 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6" returned: 0 in 1.135s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:09 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 Jul 03 16:23:09 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:09 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.info" returned: 0 in 0.893s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:09 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.info is being set with open permissions: ugo+rw Jul 03 16:23:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:10 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.info Jul 03 16:23:10 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:10 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6" returned: 1 in 1.002s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Downloaded image a5edd4aa-3f97-4644-9685-8001dd3a8cdd ((None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}])) to volume 7d85832a-40f3-46af-8c2c-5becdd2c57d6 successfully. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Temporary image a5edd4aa-3f97-4644-9685-8001dd3a8cdd for user 35ec0efb55ce42e2a236d17ec32ff5d3 is deleted. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Marking volume 7d85832a-40f3-46af-8c2c-5becdd2c57d6 as bootable. {{(pid=86659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Copying metadata from image a5edd4aa-3f97-4644-9685-8001dd3a8cdd to 7d85832a-40f3-46af-8c2c-5becdd2c57d6. {{(pid=86659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Creating volume glance metadata for volume 7d85832a-40f3-46af-8c2c-5becdd2c57d6 backed by image a5edd4aa-3f97-4644-9685-8001dd3a8cdd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 16:23:10 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.info" returned: 0 in 0.853s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.169s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:10 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e971a2d2-aae2-4984-9d1f-0d16e27b0957 tempest-VolumesDeleteCascade-274439013 None] Create snapshot completed successfully Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe3d317-5408-40c6-9a20-5b571eb3ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26799926-8cf5-4360-9511-c280e1961189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Volume volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 (7d85832a-40f3-46af-8c2c-5becdd2c57d6): created successfully Jul 03 16:23:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26799926-8cf5-4360-9511-c280e1961189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (c4ba96ef-8c45-4d33-8a03-924bef47b26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:23:11 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-bc116ea2-4836-4a0c-9763-4f6dec52dce2 tempest-VolumesGetTest-1378786862 None] Created volume successfully. Jul 03 16:23:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Creating offline snapshot a75f3ec1-1f30-456b-bb76-98bc5ec1d22e of volume 02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:23:11 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f5614-3834-4b0b-90a8-350ddf05c5a3]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:11 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 Jul 03 16:23:11 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:12 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929" returned: 0 in 1.074s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:23:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:12 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e 1G Jul 03 16:23:12 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (bad01784-9cc3-42eb-bbb2-400b9560834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a582d52-b123-4fd9-936b-ea47052bd4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a582d52-b123-4fd9-936b-ea47052bd4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:23:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-352010210',display_name='tempest-VolumesGetTest-Volume-1605019681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a263bb0-2fc8-4ebc-8004-ab0d69188994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:23:13Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958a1d62-9912-415b-a8a3-ee835ca3d402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958a1d62-9912-415b-a8a3-ee835ca3d402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc9f97f-4fb6-4cd6-be35-bbaeba3e17f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc9f97f-4fb6-4cd6-be35-bbaeba3e17f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a263bb0-2fc8-4ebc-8004-ab0d69188994', 'volume_name': 'volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0129c5e3-7beb-4868-a5b9-236be3996f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0129c5e3-7beb-4868-a5b9-236be3996f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649a93bd-35a9-468e-add8-921a78b54f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:13 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Volume 0a263bb0-2fc8-4ebc-8004-ab0d69188994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994', 'volume_size': 1} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:13 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e 1G" returned: 0 in 1.030s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:13 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e Jul 03 16:23:13 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:14 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e" returned: 0 in 0.873s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:14 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e is being set with open permissions: ugo+rw Jul 03 16:23:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:14 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e Jul 03 16:23:14 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:15 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e" returned: 0 in 0.834s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.943s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.155s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:23:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-352010210',display_name='tempest-VolumesGetTest-Volume-1605019681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a263bb0-2fc8-4ebc-8004-ab0d69188994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59446f7e01c47888e9d8409d982e733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:23:13Z,use_quota=True,user_id='35ec0efb55ce42e2a236d17ec32ff5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Creating volume 0a263bb0-2fc8-4ebc-8004-ab0d69188994 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:23:15 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:15 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 1073741824 Jul 03 16:23:15 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ce65d917-f644-4555-94de-74a4fc5b9d26 tempest-VolumesDeleteCascade-274439013 None] Create snapshot completed successfully Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Performing cascade delete. {{(pid=86659) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-8e73959e-ff1d-4cfb-b935-e0bf7b904929-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-8e73959e-ff1d-4cfb-b935-e0bf7b904929-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-8e73959e-ff1d-4cfb-b935-e0bf7b904929" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-8e73959e-ff1d-4cfb-b935-e0bf7b904929" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Deleting offline snapshot 8e73959e-ff1d-4cfb-b935-e0bf7b904929 of volume 02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] snapshot_file for this snap is: volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0f6763-782f-436a-bf04-b0e6697ad1ef]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:16 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 Jul 03 16:23:16 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:16 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 1073741824" returned: 0 in 1.418s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:16 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 Jul 03 16:23:16 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:17 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929" returned: 0 in 1.203s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31602796-4c7e-47a1-97f2-94b20e60ce1d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:17 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f Jul 03 16:23:17 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:17 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994" returned: 0 in 1.064s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] <== create_volume: return (2552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649a93bd-35a9-468e-add8-921a78b54f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6078355b-98c1-4107-b5c6-18123184018e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:17 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Volume volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 (0a263bb0-2fc8-4ebc-8004-ab0d69188994): created successfully Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6078355b-98c1-4107-b5c6-18123184018e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Flow 'volume_create_manager' (bad01784-9cc3-42eb-bbb2-400b9560834c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:23:17 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-51fab19b-7f9b-4721-815a-022a2d33036d tempest-VolumesGetTest-1378786862 None] Created volume successfully. Jul 03 16:23:18 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" returned: 0 in 1.272s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3935f7-7a56-45ca-84c4-cbf76b3c323d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:18 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e Jul 03 16:23:18 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-0a263bb0-2fc8-4ebc-8004-ab0d69188994-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Lock "cinder-0a263bb0-2fc8-4ebc-8004-ab0d69188994-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:19 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:23:19 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-quobyte-0a263bb0-2fc8-4ebc-8004-ab0d69188994" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-0a263bb0-2fc8-4ebc-8004-ab0d69188994" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:19 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb36662-5eeb-48fe-b344-4fb9a607163d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:19 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 Jul 03 16:23:19 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:20 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.133s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:23:20 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e" returned: 0 in 1.716s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0900c423-3d53-42ec-8b17-1d5e7feac86d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:20 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 Jul 03 16:23:20 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994" returned: 0 in 1.342s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:20 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:20 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994 Jul 03 16:23:20 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:21 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929" returned: 0 in 1.133s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5f66d-2233-4cfe-a800-7ef415a43693]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:21 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a263bb0-2fc8-4ebc-8004-ab0d69188994" returned: 0 in 1.038s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:21 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f Jul 03 16:23:21 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-0a263bb0-2fc8-4ebc-8004-ab0d69188994" released by "delete_volume" :: held 2.472s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Created reservations ['2bd6b4a4-ea1a-42a3-aabf-dd1988d7b207', '957a1289-5f9b-4c15-a323-a66dbd4050ce', '0f3ba720-7ce7-436f-9c2c-dda13d6df11b', '3e705767-21c8-4152-9be7-4b45dcc71379'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:21 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:23:21 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:22 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" returned: 0 in 1.039s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:22 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 Jul 03 16:23:22 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-7d85832a-40f3-46af-8c2c-5becdd2c57d6-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Lock "cinder-7d85832a-40f3-46af-8c2c-5becdd2c57d6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Acquiring lock "cinder-quobyte-7d85832a-40f3-46af-8c2c-5becdd2c57d6" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-7d85832a-40f3-46af-8c2c-5becdd2c57d6" acquired by "delete_volume" :: waited 0.040s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:22 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.976s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:23:22 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Deleted volume successfully. Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0655d6b3-0d67-4c05-b86c-68ed6cde9657 tempest-VolumesGetTest-1378786862 None] Lock "cinder-0a263bb0-2fc8-4ebc-8004-ab0d69188994-delete_volume" released by "delete_volume" :: held 3.942s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d12b134-e887-406a-a575-793636e365fc]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:23 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 Jul 03 16:23:23 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:23 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929" returned: 0 in 0.963s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:23 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929 Jul 03 16:23:23 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:23 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6" returned: 0 in 1.037s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:24 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 Jul 03 16:23:24 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:24 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.8e73959e-ff1d-4cfb-b935-e0bf7b904929" returned: 0 in 0.874s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e -F qcow2 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:24 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e -F qcow2 Jul 03 16:23:24 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:25 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6" returned: 1 in 1.038s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:25 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6 Jul 03 16:23:25 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:25 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e -F qcow2" returned: 0 in 0.846s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-8e73959e-ff1d-4cfb-b935-e0bf7b904929" released by "_delete_snapshot" :: held 9.324s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" released by "delete_snapshot" :: held 9.361s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Created reservations ['1b8906c6-b520-4a36-b904-d1257db57c8a', '2ce43e40-2b05-411c-b0e7-de2e2c3cc460', '9b2b7ccc-5a87-4dd7-afda-a8ac5d140cdb', 'ad9c9b19-5211-448c-b3f6-4b72e09d2a88'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:23:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Delete snapshot completed successfully. Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-8e73959e-ff1d-4cfb-b935-e0bf7b904929-delete_snapshot" released by "delete_snapshot" :: held 9.687s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-a75f3ec1-1f30-456b-bb76-98bc5ec1d22e-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-a75f3ec1-1f30-456b-bb76-98bc5ec1d22e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-a75f3ec1-1f30-456b-bb76-98bc5ec1d22e" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-a75f3ec1-1f30-456b-bb76-98bc5ec1d22e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Deleting offline snapshot a75f3ec1-1f30-456b-bb76-98bc5ec1d22e of volume 02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] snapshot_file for this snap is: volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1d5272-1080-46b7-9014-8636fd8fc0c7]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:25 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e Jul 03 16:23:25 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:25 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7d85832a-40f3-46af-8c2c-5becdd2c57d6" returned: 0 in 0.911s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Lock "cinder-quobyte-7d85832a-40f3-46af-8c2c-5becdd2c57d6" released by "delete_volume" :: held 3.086s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Created reservations ['b5acbeb2-7836-4319-aece-a40ae6355e9e', 'b9f1691e-0603-4572-8dfa-f0166c3cf25d', 'b4ae4042-515d-4fde-8c87-8867cf9b64e1', '349b10a4-c207-49f2-b2d3-29f0cddb356a'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:26 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:23:26 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:26 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e" returned: 0 in 0.947s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b316a3d-a668-43ff-8bfd-9727c8df9f9d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:26 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f Jul 03 16:23:26 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:27 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.192s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:27 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:23:27 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Deleted volume successfully. Jul 03 16:23:27 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9d41df4e-d539-4446-9edf-01d96446c005 tempest-VolumesGetTest-1378786862 None] Lock "cinder-7d85832a-40f3-46af-8c2c-5becdd2c57d6-delete_volume" released by "delete_volume" :: held 4.675s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:28 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" returned: 0 in 1.711s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:28 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e Jul 03 16:23:28 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:29 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e" returned: 0 in 1.068s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:29 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e Jul 03 16:23:29 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:30 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f.a75f3ec1-1f30-456b-bb76-98bc5ec1d22e" returned: 0 in 0.912s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-a75f3ec1-1f30-456b-bb76-98bc5ec1d22e" released by "_delete_snapshot" :: held 4.812s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" released by "delete_snapshot" :: held 4.848s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Created reservations ['a177539b-7116-4949-b5fc-77d5b071c527', 'efb9a035-8099-4001-9701-fe5fa36edcbc', 'c3a26342-ac6b-4c5a-b78d-f46fc67c4285', '917be5b2-cc5f-4916-bff2-5ef410f323b8'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:23:30 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Delete snapshot completed successfully. Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-a75f3ec1-1f30-456b-bb76-98bc5ec1d22e-delete_snapshot" released by "delete_snapshot" :: held 5.097s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Snapshots deleted, issuing volume delete {{(pid=86659) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf6240-427a-47a4-baeb-c516fa5c42b7]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:30 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f Jul 03 16:23:30 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:31 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" returned: 0 in 1.148s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:31 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f Jul 03 16:23:31 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:33 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" returned: 0 in 1.776s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f" released by "delete_volume" :: held 3.092s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:33 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=110,cinder:INSERT=39,cinder:DELETE=9,cinder:SELECT=92 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:23:33 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=108,cinder:SELECT=98,cinder:INSERT=37,cinder:DELETE=10 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:23:33 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Created reservations ['fc6b9141-0692-4ebd-a412-341d52eb978f', 'b096d19d-8b12-4cfc-b0c4-afa10d0eca82', 'f157fcd1-7995-4442-bd03-730fa623cc56', 'f009beb0-064d-4b98-9c5e-14423c6db390'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:23:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:34 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:23:34 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:35 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.278s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:35 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:23:35 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Deleted volume successfully. Jul 03 16:23:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ae28e194-639c-4c9d-bdd9-e7b06e2867c0 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-02bdd7d4-5a77-4fe4-82fd-34d90c63f87f-delete_volume" released by "delete_volume" :: held 19.794s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Flow 'volume_create_manager' (14397012-c84e-4d09-a28f-8c8c88907900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8381681f-7e1a-461f-876e-a8d1ff9ddd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8381681f-7e1a-461f-876e-a8d1ff9ddd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-236155236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ea83e6-869b-4786-93bb-264e9754b2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1720ee9ffd104b79aa20f2ec463c9e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:23:37Z,use_quota=True,user_id='1315389d63734e06906aa8bffa492c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c51273-93c7-4c7b-8116-554d00a26c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c51273-93c7-4c7b-8116-554d00a26c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7549b0a-cde4-4e4d-a81b-3eeb93a5d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7549b0a-cde4-4e4d-a81b-3eeb93a5d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ea83e6-869b-4786-93bb-264e9754b2c0', 'volume_name': 'volume-78ea83e6-869b-4786-93bb-264e9754b2c0', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a1819f-5279-48ad-9a09-d2acc13c2fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a1819f-5279-48ad-9a09-d2acc13c2fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da1601b-77fe-4b66-a56e-038d619f0d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:36 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Volume 78ea83e6-869b-4786-93bb-264e9754b2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ea83e6-869b-4786-93bb-264e9754b2c0', 'volume_size': 1} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-236155236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ea83e6-869b-4786-93bb-264e9754b2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1720ee9ffd104b79aa20f2ec463c9e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:23:37Z,use_quota=True,user_id='1315389d63734e06906aa8bffa492c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Creating volume 78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:23:36 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:23:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:36 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 1073741824 Jul 03 16:23:36 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:38 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 1073741824" returned: 0 in 1.560s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:38 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 Jul 03 16:23:38 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:39 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0" returned: 0 in 1.083s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] <== create_volume: return (2696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:23:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.699s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da1601b-77fe-4b66-a56e-038d619f0d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ea83e6-869b-4786-93bb-264e9754b2c0', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ac4333-87ea-40a9-bb5e-a2a868a5d949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:39 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Volume volume-78ea83e6-869b-4786-93bb-264e9754b2c0 (78ea83e6-869b-4786-93bb-264e9754b2c0): created successfully Jul 03 16:23:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ac4333-87ea-40a9-bb5e-a2a868a5d949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Flow 'volume_create_manager' (14397012-c84e-4d09-a28f-8c8c88907900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:23:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0840ab38-b4c8-4b13-ad4d-acc8f16048de tempest-VolumesDeleteCascade-274439013 None] Created volume successfully. Jul 03 16:23:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Creating offline snapshot ba21bbf7-bf0d-480b-9398-342e94c79594 of volume 78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:23:40 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff01310-8bd8-486f-bab1-186f2084fa3e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:40 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 Jul 03 16:23:40 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:41 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0" returned: 0 in 1.307s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:41 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 1G Jul 03 16:23:41 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:42 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 1G" returned: 0 in 0.982s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ea83e6-869b-4786-93bb-264e9754b2c0 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:42 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ea83e6-869b-4786-93bb-264e9754b2c0 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 Jul 03 16:23:42 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:43 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ea83e6-869b-4786-93bb-264e9754b2c0 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594" returned: 0 in 0.808s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:43 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 is being set with open permissions: ugo+rw Jul 03 16:23:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:43 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 Jul 03 16:23:43 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:44 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594" returned: 0 in 0.853s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:44 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.info Jul 03 16:23:44 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:45 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.info" returned: 0 in 0.939s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:45 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.info is being set with open permissions: ugo+rw Jul 03 16:23:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:45 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.info Jul 03 16:23:45 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:46 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.info" returned: 0 in 0.851s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.888s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:46 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b41be0dd-ac4b-439f-baac-4dda0e2ba180 tempest-VolumesDeleteCascade-274439013 None] Create snapshot completed successfully Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Flow 'volume_create_manager' (636cc180-6098-428b-b5ad-1456feda408d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce73d0ae-f831-4ec1-9d13-bff721472e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce73d0ae-f831-4ec1-9d13-bff721472e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1493756592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3c2417-9f3f-4fd9-ab67-18085090599b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1720ee9ffd104b79aa20f2ec463c9e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba21bbf7-bf0d-480b-9398-342e94c79594,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:23:47Z,use_quota=True,user_id='1315389d63734e06906aa8bffa492c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397a193f-8050-4a6a-a289-ccc85191b8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397a193f-8050-4a6a-a289-ccc85191b8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b565d07f-67fc-4ba0-9ea6-7b558843407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b565d07f-67fc-4ba0-9ea6-7b558843407b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb3c2417-9f3f-4fd9-ab67-18085090599b', 'volume_name': 'volume-bb3c2417-9f3f-4fd9-ab67-18085090599b', 'volume_size': 1, 'snapshot_id': 'ba21bbf7-bf0d-480b-9398-342e94c79594'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d843d741-f049-4ebd-85db-b84308b14f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d843d741-f049-4ebd-85db-b84308b14f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e82067a-c5cd-4079-8d9e-08105ff1c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:47 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Volume bb3c2417-9f3f-4fd9-ab67-18085090599b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb3c2417-9f3f-4fd9-ab67-18085090599b', 'volume_size': 1, 'snapshot_id': 'ba21bbf7-bf0d-480b-9398-342e94c79594'} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-ba21bbf7-bf0d-480b-9398-342e94c79594-bb3c2417-9f3f-4fd9-ab67-18085090599b" by "_create_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-ba21bbf7-bf0d-480b-9398-342e94c79594-bb3c2417-9f3f-4fd9-ab67-18085090599b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Creating volume bb3c2417-9f3f-4fd9-ab67-18085090599b from snapshot ba21bbf7-bf0d-480b-9398-342e94c79594 {{(pid=86659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-bb3c2417-9f3f-4fd9-ab67-18085090599b" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-bb3c2417-9f3f-4fd9-ab67-18085090599b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] snapshot: ba21bbf7-bf0d-480b-9398-342e94c79594, volume: bb3c2417-9f3f-4fd9-ab67-18085090599b, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[268ba57c-aa11-4820-a6d7-f680f9893f08]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:47 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 Jul 03 16:23:47 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:48 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594" returned: 0 in 1.056s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ea83e6-869b-4786-93bb-264e9754b2c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:23:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:23:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:23:48 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9875cc8d-72d9-49ed-b738-913315dd2a40]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:48 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 Jul 03 16:23:48 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:49 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0" returned: 0 in 1.050s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:49 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:23:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:49 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b Jul 03 16:23:49 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:57 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:23:57 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:23:58 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b" returned: 0 in 8.232s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:58 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8543763a-e0db-4555-a6ef-09c72a138fbc]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:23:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:58 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 Jul 03 16:23:58 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Flow 'volume_create_manager' (f6a26e5e-7e33-4b26-810c-b4554e41344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c80d39b-41e8-467a-b3cc-1d5bb9d8837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c80d39b-41e8-467a-b3cc-1d5bb9d8837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-648741831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5bec88-dd66-4975-aa06-1b2ed1347584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692b2a15a294402b075e614292d1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:23:59Z,use_quota=True,user_id='1e4ae87af9a54a388fe862a5bdc7b4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850a181a-7c8c-47ad-baed-6d4d7b86b5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850a181a-7c8c-47ad-baed-6d4d7b86b5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba492448-8f72-455c-87bc-e903bf75a4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba492448-8f72-455c-87bc-e903bf75a4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5bec88-dd66-4975-aa06-1b2ed1347584', 'volume_name': 'volume-4b5bec88-dd66-4975-aa06-1b2ed1347584', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f031e58b-23f4-41c4-8ae9-e1deaa2d5d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f031e58b-23f4-41c4-8ae9-e1deaa2d5d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea537c3a-9fe4-46d0-b3ae-56746578b2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:23:59 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Volume 4b5bec88-dd66-4975-aa06-1b2ed1347584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5bec88-dd66-4975-aa06-1b2ed1347584', 'volume_size': 1} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:59 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0" returned: 0 in 1.108s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0, size 1024.00 MB, duration 8.23 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:23:59 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Converted 1024.00 MB image at 124.37 MB/s Jul 03 16:23:59 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b is being set with open permissions: ugo+rw Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:23:59 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b Jul 03 16:23:59 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:23:59 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b" returned: 0 in 0.713s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-bb3c2417-9f3f-4fd9-ab67-18085090599b" released by "_copy_volume_from_snapshot" :: held 12.312s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-ba21bbf7-bf0d-480b-9398-342e94c79594-bb3c2417-9f3f-4fd9-ab67-18085090599b" released by "_create_volume_from_snapshot" :: held 12.356s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.374s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.826s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-648741831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5bec88-dd66-4975-aa06-1b2ed1347584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9692b2a15a294402b075e614292d1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:23:59Z,use_quota=True,user_id='1e4ae87af9a54a388fe862a5bdc7b4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Creating volume 4b5bec88-dd66-4975-aa06-1b2ed1347584 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:23:59 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:23:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:00 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 1073741824 Jul 03 16:24:00 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e82067a-c5cd-4079-8d9e-08105ff1c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3c2417-9f3f-4fd9-ab67-18085090599b', 'volume_size': 1, 'snapshot_id': 'ba21bbf7-bf0d-480b-9398-342e94c79594'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d639c370-fcc8-48e2-860f-8c6dad5efad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:00 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Volume volume-bb3c2417-9f3f-4fd9-ab67-18085090599b (bb3c2417-9f3f-4fd9-ab67-18085090599b): created successfully Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d639c370-fcc8-48e2-860f-8c6dad5efad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Flow 'volume_create_manager' (636cc180-6098-428b-b5ad-1456feda408d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:00 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f3ba9387-a1b1-4813-91f9-e48be8d50984 tempest-VolumesDeleteCascade-274439013 None] Created volume successfully. Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-78ea83e6-869b-4786-93bb-264e9754b2c0-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-78ea83e6-869b-4786-93bb-264e9754b2c0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Performing cascade delete. {{(pid=86659) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-ba21bbf7-bf0d-480b-9398-342e94c79594-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-ba21bbf7-bf0d-480b-9398-342e94c79594-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-78ea83e6-869b-4786-93bb-264e9754b2c0" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-78ea83e6-869b-4786-93bb-264e9754b2c0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-ba21bbf7-bf0d-480b-9398-342e94c79594" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-ba21bbf7-bf0d-480b-9398-342e94c79594" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Deleting offline snapshot ba21bbf7-bf0d-480b-9398-342e94c79594 of volume 78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] snapshot_file for this snap is: volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e90ec8-faa2-424a-9940-0fa9963082e1]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:00 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 Jul 03 16:24:00 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:01 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 1073741824" returned: 0 in 1.153s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:01 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 Jul 03 16:24:01 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:01 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594" returned: 0 in 1.096s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ea83e6-869b-4786-93bb-264e9754b2c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:24:02 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ea614-ee32-45b2-8a6f-863c6770ccc5]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:02 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 Jul 03 16:24:02 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:02 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584" returned: 0 in 1.081s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea537c3a-9fe4-46d0-b3ae-56746578b2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5bec88-dd66-4975-aa06-1b2ed1347584', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46383e03-7a90-46fd-9e63-9eb186e4e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:02 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Volume volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 (4b5bec88-dd66-4975-aa06-1b2ed1347584): created successfully Jul 03 16:24:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46383e03-7a90-46fd-9e63-9eb186e4e39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:02 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Flow 'volume_create_manager' (f6a26e5e-7e33-4b26-810c-b4554e41344c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:02 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c5ba5fcb-15aa-41f9-832c-239f09e2dc18 tempest-AttachVolumeNegativeTest-2091901602 None] Created volume successfully. Jul 03 16:24:03 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0" returned: 0 in 1.749s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:03 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 Jul 03 16:24:03 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (b5f352ee-01aa-44e1-9201-49319d4bdd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8818eeaa-0547-4d5d-968b-64a32e11c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8818eeaa-0547-4d5d-968b-64a32e11c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1972920459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf5e525-1be8-4237-9acc-abfed15fb955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:05Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3c43a3-3e44-4d1f-97dc-a806c3d849b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:05 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3c43a3-3e44-4d1f-97dc-a806c3d849b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12767d06-3677-4e71-b1bf-5c7e9d07824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12767d06-3677-4e71-b1bf-5c7e9d07824c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf5e525-1be8-4237-9acc-abfed15fb955', 'volume_name': 'volume-2bf5e525-1be8-4237-9acc-abfed15fb955', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e3df3d-ed08-4ef4-b94f-6253c0718007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e3df3d-ed08-4ef4-b94f-6253c0718007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d5683b-a1d0-4559-b77d-5f43869b5eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:05 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Volume 2bf5e525-1be8-4237-9acc-abfed15fb955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf5e525-1be8-4237-9acc-abfed15fb955', 'volume_size': 1} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1972920459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf5e525-1be8-4237-9acc-abfed15fb955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:05Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Creating volume 2bf5e525-1be8-4237-9acc-abfed15fb955 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:05 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594" returned: 0 in 1.776s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:05 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594 Jul 03 16:24:05 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:05 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955 1073741824 Jul 03 16:24:05 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:07 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0.ba21bbf7-bf0d-480b-9398-342e94c79594" returned: 0 in 1.531s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-ba21bbf7-bf0d-480b-9398-342e94c79594" released by "_delete_snapshot" :: held 6.381s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-78ea83e6-869b-4786-93bb-264e9754b2c0" released by "delete_snapshot" :: held 6.415s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Created reservations ['eec9d05d-519d-442c-8c15-66067ed005a3', '5db2f37f-0135-44a7-8a1c-f67f76d5815d', '63c70ebc-ba2e-421e-8f58-dbfaf2f5a7a8', '19291c3f-cbb4-45ea-9926-61691ead013a'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:07 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Delete snapshot completed successfully. Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-ba21bbf7-bf0d-480b-9398-342e94c79594-delete_snapshot" released by "delete_snapshot" :: held 6.738s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Snapshots deleted, issuing volume delete {{(pid=86659) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-78ea83e6-869b-4786-93bb-264e9754b2c0" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-78ea83e6-869b-4786-93bb-264e9754b2c0" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d9ddcb-66c8-4f7a-bcfd-6ba85a8605e1]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-38490f09-e1dc-4638-8076-4cab14c9bd6e req-feb2b747-65fc-45f3-94e5-1bff2f5d373e tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:07 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 Jul 03 16:24:07 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:07 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955 1073741824" returned: 0 in 2.344s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:08 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955 Jul 03 16:24:08 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:08 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0" returned: 0 in 1.099s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:08 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0 Jul 03 16:24:08 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:09 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955" returned: 0 in 1.306s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] <== create_volume: return (3768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.773s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-38490f09-e1dc-4638-8076-4cab14c9bd6e req-feb2b747-65fc-45f3-94e5-1bff2f5d373e tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.665s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d5683b-a1d0-4559-b77d-5f43869b5eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf5e525-1be8-4237-9acc-abfed15fb955', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05f6dcf-df49-464e-84d8-a9f2effa7c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6122ba53-0ab4-441a-9504-49e4df841796]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-38490f09-e1dc-4638-8076-4cab14c9bd6e req-feb2b747-65fc-45f3-94e5-1bff2f5d373e tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:09 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Volume volume-2bf5e525-1be8-4237-9acc-abfed15fb955 (2bf5e525-1be8-4237-9acc-abfed15fb955): created successfully Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05f6dcf-df49-464e-84d8-a9f2effa7c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (b5f352ee-01aa-44e1-9201-49319d4bdd51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:09 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a2ea6062-3cd9-49d7-aaba-f622a9bd11cc tempest-VolumesActionsTest-1580192176 None] Created volume successfully. Jul 03 16:24:09 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 Jul 03 16:24:09 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23b044bd-000f-405d-a8ca-b56cde0c3bce tempest-VolumesActionsTest-1580192176 None] Acquiring lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955" by "attach_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23b044bd-000f-405d-a8ca-b56cde0c3bce tempest-VolumesActionsTest-1580192176 None] Lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955" acquired by "attach_volume" :: waited 0.060s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:10 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-23b044bd-000f-405d-a8ca-b56cde0c3bce tempest-VolumesActionsTest-1580192176 None] Attaching volume 2bf5e525-1be8-4237-9acc-abfed15fb955 to instance 08cdcc9b-a965-4ec0-a003-7d552407adbd at mountpoint /dev/vdb on host None. Jul 03 16:24:10 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-23b044bd-000f-405d-a8ca-b56cde0c3bce tempest-VolumesActionsTest-1580192176 None] Attach volume completed successfully. Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23b044bd-000f-405d-a8ca-b56cde0c3bce tempest-VolumesActionsTest-1580192176 None] Lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955" released by "attach_volume" :: held 0.183s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:10 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-78ea83e6-869b-4786-93bb-264e9754b2c0" returned: 0 in 1.447s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-78ea83e6-869b-4786-93bb-264e9754b2c0" released by "delete_volume" :: held 2.669s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Created reservations ['94d52aca-f978-4840-85fb-595dfdc7c845', '32e8a7f3-b030-4144-bce2-abc0e8eca5e6', '88a4be7a-f9a3-4583-8cbb-e9bfbbcad524', '21208b28-7962-4a95-a3fd-e96d42721c2b'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:10 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:10 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:11 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-38490f09-e1dc-4638-8076-4cab14c9bd6e req-feb2b747-65fc-45f3-94e5-1bff2f5d373e tempest-AttachVolumeNegativeTest-2091901602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584" returned: 0 in 1.715s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-38490f09-e1dc-4638-8076-4cab14c9bd6e req-feb2b747-65fc-45f3-94e5-1bff2f5d373e tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.776s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-38490f09-e1dc-4638-8076-4cab14c9bd6e req-feb2b747-65fc-45f3-94e5-1bff2f5d373e tempest-AttachVolumeNegativeTest-2091901602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-4b5bec88-dd66-4975-aa06-1b2ed1347584', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8246784f-696c-45fe-bb64-e4784bdb64e7', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:24:11 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-38490f09-e1dc-4638-8076-4cab14c9bd6e req-feb2b747-65fc-45f3-94e5-1bff2f5d373e tempest-AttachVolumeNegativeTest-2091901602 None] attachment_update completed successfully. Jul 03 16:24:11 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.277s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:11 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:11 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Deleted volume successfully. Jul 03 16:24:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50e86c49-604f-4e41-ba38-3ebe50b9fdaa tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-78ea83e6-869b-4786-93bb-264e9754b2c0-delete_volume" released by "delete_volume" :: held 11.045s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-bb3c2417-9f3f-4fd9-ab67-18085090599b-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-bb3c2417-9f3f-4fd9-ab67-18085090599b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "cinder-quobyte-bb3c2417-9f3f-4fd9-ab67-18085090599b" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:11 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0ce1ac76-7c02-4d84-9a4d-5253701a974c tempest-VolumesActionsTest-1185536327 None] Terminate volume connection completed successfully. Jul 03 16:24:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-bb3c2417-9f3f-4fd9-ab67-18085090599b" acquired by "delete_volume" :: waited 0.055s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:12 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f66ee-7bf6-451a-b94c-4180ef4a0774]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:12 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b Jul 03 16:24:12 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0ce1ac76-7c02-4d84-9a4d-5253701a974c tempest-VolumesActionsTest-1185536327 None] Acquiring lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955-detach_volume" by "detach_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0ce1ac76-7c02-4d84-9a4d-5253701a974c tempest-VolumesActionsTest-1185536327 None] Lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0ce1ac76-7c02-4d84-9a4d-5253701a974c tempest-VolumesActionsTest-1185536327 None] Detaching volume 2bf5e525-1be8-4237-9acc-abfed15fb955 from instance 08cdcc9b-a965-4ec0-a003-7d552407adbd. Jul 03 16:24:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0ce1ac76-7c02-4d84-9a4d-5253701a974c tempest-VolumesActionsTest-1185536327 None] Detach volume completed successfully. Jul 03 16:24:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0ce1ac76-7c02-4d84-9a4d-5253701a974c tempest-VolumesActionsTest-1185536327 None] Lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:13 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b" returned: 0 in 1.049s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:13 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b Jul 03 16:24:13 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5ef182ea-03b8-49be-919b-89e0a988cae2 tempest-VolumesActionsTest-1580192176 None] Acquiring lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955-detach_volume" by "detach_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5ef182ea-03b8-49be-919b-89e0a988cae2 tempest-VolumesActionsTest-1580192176 None] Lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:13 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-5ef182ea-03b8-49be-919b-89e0a988cae2 tempest-VolumesActionsTest-1580192176 None] Volume detach called, but volume not attached. Jul 03 16:24:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5ef182ea-03b8-49be-919b-89e0a988cae2 tempest-VolumesActionsTest-1580192176 None] Lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:13 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-bb3c2417-9f3f-4fd9-ab67-18085090599b" returned: 0 in 0.868s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-quobyte-bb3c2417-9f3f-4fd9-ab67-18085090599b" released by "delete_volume" :: held 2.004s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Created reservations ['903e7da8-1b29-40ec-b617-67f87c6f35d3', 'ebafca7f-aceb-4b90-be5c-351aee00c55e', '6e83be55-fc38-4279-a69d-a2cee57502b7', '29b251f5-10cc-4b3f-9feb-ae327f54d19f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Acquiring lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Acquiring lock "cinder-quobyte-2bf5e525-1be8-4237-9acc-abfed15fb955" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Lock "cinder-quobyte-2bf5e525-1be8-4237-9acc-abfed15fb955" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5649ae-afe1-485d-ae79-b1d0fd3a01dc]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:14 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:14 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:14 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955 Jul 03 16:24:14 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:15 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.073s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:15 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Deleted volume successfully. Jul 03 16:24:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9313ce64-c884-4b1a-9747-616a932fd257 tempest-VolumesDeleteCascade-274439013 None] Lock "cinder-bb3c2417-9f3f-4fd9-ab67-18085090599b-delete_volume" released by "delete_volume" :: held 3.743s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:15 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955" returned: 0 in 1.578s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:16 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955 Jul 03 16:24:16 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:17 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2bf5e525-1be8-4237-9acc-abfed15fb955" returned: 0 in 1.172s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Lock "cinder-quobyte-2bf5e525-1be8-4237-9acc-abfed15fb955" released by "delete_volume" :: held 2.847s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Created reservations ['86960e45-80a8-43ba-bf32-1b8e527dbe68', '6fa3a060-bed8-4a01-9fba-1f2d8ee251ac', 'c0757fa2-b069-42d0-9a79-73e2008f9bf3', 'ca569a57-7822-4ed8-9d46-77049f7e96c4'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:17 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:17 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Flow 'volume_create_manager' (383906cf-2664-4cee-8bbb-b9a830edaf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da2654f-0fad-4160-a735-31b5d14e3b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da2654f-0fad-4160-a735-31b5d14e3b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-963617416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e689455e-2810-4a8f-b551-c484668e85f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069f009af36446df84091c1e6133ac99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:18Z,use_quota=True,user_id='61ed50c4f2684a04b4b51ad1318e0e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c03fb33-4d5a-4c9a-bf6d-19a58d16de0f),volume_type_id=9c03fb33-4d5a-4c9a-bf6d-19a58d16de0f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e9b9ba-7577-4dea-b943-35a105d4ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e9b9ba-7577-4dea-b943-35a105d4ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12be8cb-324d-435d-a799-2151d1be7d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12be8cb-324d-435d-a799-2151d1be7d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e689455e-2810-4a8f-b551-c484668e85f6', 'volume_name': 'volume-e689455e-2810-4a8f-b551-c484668e85f6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c23a59-b7a8-441d-bfcd-50543e79d419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c23a59-b7a8-441d-bfcd-50543e79d419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b505e2-0ee7-4964-b8a9-c75cec085082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:17 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Volume e689455e-2810-4a8f-b551-c484668e85f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e689455e-2810-4a8f-b551-c484668e85f6', 'volume_size': 1} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-963617416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e689455e-2810-4a8f-b551-c484668e85f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069f009af36446df84091c1e6133ac99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:18Z,use_quota=True,user_id='61ed50c4f2684a04b4b51ad1318e0e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c03fb33-4d5a-4c9a-bf6d-19a58d16de0f),volume_type_id=9c03fb33-4d5a-4c9a-bf6d-19a58d16de0f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Creating volume e689455e-2810-4a8f-b551-c484668e85f6 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:17 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:18 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 1073741824 Jul 03 16:24:18 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Flow 'volume_create_manager' (943b4170-7859-47da-bd0a-7df876fe0637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40561071-1caf-4991-89f3-f8a422a397ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:18 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40561071-1caf-4991-89f3-f8a422a397ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-71472875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e73a73-3c91-4522-aeda-7d515578d4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069f009af36446df84091c1e6133ac99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:19Z,use_quota=True,user_id='61ed50c4f2684a04b4b51ad1318e0e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81f39ecc-8311-48fd-931a-59a9fd3463b2),volume_type_id=81f39ecc-8311-48fd-931a-59a9fd3463b2)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8813ace-d779-45da-8827-b25edbf2cc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8813ace-d779-45da-8827-b25edbf2cc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98fba09d-6310-4c7f-9de5-48da9064a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98fba09d-6310-4c7f-9de5-48da9064a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e73a73-3c91-4522-aeda-7d515578d4d5', 'volume_name': 'volume-96e73a73-3c91-4522-aeda-7d515578d4d5', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4a4ef4-ca07-4077-a6f0-eb613bb22504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4a4ef4-ca07-4077-a6f0-eb613bb22504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b467568-76e6-4878-b725-e3e267c0e727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Volume 96e73a73-3c91-4522-aeda-7d515578d4d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e73a73-3c91-4522-aeda-7d515578d4d5', 'volume_size': 1} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.355s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Deleted volume successfully. Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-44ad5be9-6edd-4de9-940a-7498d72fe88d tempest-VolumesActionsTest-1580192176 None] Lock "cinder-2bf5e525-1be8-4237-9acc-abfed15fb955-delete_volume" released by "delete_volume" :: held 4.669s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.077s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:19 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:19 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:19 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-4f8394fc-651f-450b-9874-f295fb455d1b req-e44e9b0b-b997-43e1-a136-d3932a790169 tempest-AttachVolumeNegativeTest-2091901602 None] Terminate volume connection completed successfully. Jul 03 16:24:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-4f8394fc-651f-450b-9874-f295fb455d1b req-e44e9b0b-b997-43e1-a136-d3932a790169 tempest-AttachVolumeNegativeTest-2091901602 None] Deleting attachment 8246784f-696c-45fe-bb64-e4784bdb64e7. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:24:19 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 1073741824" returned: 0 in 1.940s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:20 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 Jul 03 16:24:20 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Flow 'volume_create_manager' (31c4bce0-5216-4ebf-8598-11809b02e656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ba0328-9f4b-4f58-aa5d-4184307a9478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ba0328-9f4b-4f58-aa5d-4184307a9478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1239273353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209eb3f6-ca26-45f5-a9a8-fa82b7c81ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069f009af36446df84091c1e6133ac99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:20Z,use_quota=True,user_id='61ed50c4f2684a04b4b51ad1318e0e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8eefe02-b9ba-4340-8e7a-f39c59ed553b),volume_type_id=f8eefe02-b9ba-4340-8e7a-f39c59ed553b)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc1ddf9-67da-472a-93ac-5fc0ffa9b133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc1ddf9-67da-472a-93ac-5fc0ffa9b133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfded54-8548-410a-8f66-6bb89a796464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.image.glance [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Creating Keystone auth plugin from conf {{(pid=86659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 16:24:20 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.504s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfded54-8548-410a-8f66-6bb89a796464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '209eb3f6-ca26-45f5-a9a8-fa82b7c81ded', 'volume_name': 'volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded', 'volume_size': 1, 'image_id': 'bc02be99-c861-4817-9c23-2d227c20da8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc02be99-c861-4817-9c23-2d227c20da8b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1724710558', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '069f009af36446df84091c1e6133ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc02be99-c861-4817-9c23-2d227c20da8b', 'created_at': datetime.datetime(2026, 7, 3, 14, 24, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 24, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc02be99-c861-4817-9c23-2d227c20da8b/file', 'properties': {}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395d5f16-a8a8-4dc6-a6b2-53e19a8018f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395d5f16-a8a8-4dc6-a6b2-53e19a8018f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dea7e1e-3cc2-467e-9335-df6cf935451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:20 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Volume 209eb3f6-ca26-45f5-a9a8-fa82b7c81ded: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded', 'volume_size': 1, 'image_id': 'bc02be99-c861-4817-9c23-2d227c20da8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc02be99-c861-4817-9c23-2d227c20da8b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1724710558', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '069f009af36446df84091c1e6133ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc02be99-c861-4817-9c23-2d227c20da8b', 'created_at': datetime.datetime(2026, 7, 3, 14, 24, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 24, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc02be99-c861-4817-9c23-2d227c20da8b/file', 'properties': {}}, 'image_service': } Jul 03 16:24:20 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Trying to clone 209eb3f6-ca26-45f5-a9a8-fa82b7c81ded from image bc02be99-c861-4817-9c23-2d227c20da8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/bc02be99-c861-4817-9c23-2d227c20da8b', 'metadata': {}}]). {{(pid=86659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 16:24:21 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6" returned: 0 in 1.386s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] <== create_volume: return (3487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.502s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.594s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-71472875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e73a73-3c91-4522-aeda-7d515578d4d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069f009af36446df84091c1e6133ac99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:19Z,use_quota=True,user_id='61ed50c4f2684a04b4b51ad1318e0e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81f39ecc-8311-48fd-931a-59a9fd3463b2),volume_type_id=81f39ecc-8311-48fd-931a-59a9fd3463b2)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Creating volume 96e73a73-3c91-4522-aeda-7d515578d4d5 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:21 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b505e2-0ee7-4964-b8a9-c75cec085082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e689455e-2810-4a8f-b551-c484668e85f6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:21 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 1073741824 Jul 03 16:24:21 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0888c9a4-b37a-4199-9228-a36ef5c1e167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:21 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Volume volume-e689455e-2810-4a8f-b551-c484668e85f6 (e689455e-2810-4a8f-b551-c484668e85f6): created successfully Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0888c9a4-b37a-4199-9228-a36ef5c1e167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Flow 'volume_create_manager' (383906cf-2664-4cee-8bbb-b9a830edaf6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3e38c544-7bea-48cd-a804-be0770f7a094 tempest-TestInstancesWithCinderVolumes-1394990013 None] Created volume successfully. Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Flow 'volume_create_manager' (ef03a7b7-27c1-4974-bf8d-f7457c7de3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8507cb29-61da-4d31-92ab-1cd520533f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8507cb29-61da-4d31-92ab-1cd520533f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-29094168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348a0fbd-da80-4571-80fa-774a341c12ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedc692c6ffd4b9f9d2599e82bc600b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:22Z,use_quota=True,user_id='b7468bbffad8483bac8cff9e9b0b215c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a23bfb1-0c08-4a8f-b9fe-c68554705082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a23bfb1-0c08-4a8f-b9fe-c68554705082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e281e0-bd73-4541-ae7d-a69e06b7b653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e281e0-bd73-4541-ae7d-a69e06b7b653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348a0fbd-da80-4571-80fa-774a341c12ae', 'volume_name': 'volume-348a0fbd-da80-4571-80fa-774a341c12ae', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abcbcef-2892-433a-a2c3-35f4723338b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abcbcef-2892-433a-a2c3-35f4723338b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae3b4f9-8594-40d5-bf0f-a66c29bbd48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:21 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Volume 348a0fbd-da80-4571-80fa-774a341c12ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348a0fbd-da80-4571-80fa-774a341c12ae', 'volume_size': 1} Jul 03 16:24:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:22 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 1073741824" returned: 0 in 1.382s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:22 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 Jul 03 16:24:22 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:23 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5" returned: 0 in 0.871s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.379s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-29094168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348a0fbd-da80-4571-80fa-774a341c12ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedc692c6ffd4b9f9d2599e82bc600b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:22Z,use_quota=True,user_id='b7468bbffad8483bac8cff9e9b0b215c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Creating volume 348a0fbd-da80-4571-80fa-774a341c12ae {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:23 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:23 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae 1073741824 Jul 03 16:24:23 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b467568-76e6-4878-b725-e3e267c0e727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e73a73-3c91-4522-aeda-7d515578d4d5', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dd7bcc-b8cd-43b1-87df-0d9f59f8537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:23 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Volume volume-96e73a73-3c91-4522-aeda-7d515578d4d5 (96e73a73-3c91-4522-aeda-7d515578d4d5): created successfully Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dd7bcc-b8cd-43b1-87df-0d9f59f8537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Flow 'volume_create_manager' (943b4170-7859-47da-bd0a-7df876fe0637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:23 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c731f7f7-31c7-4d4c-b7bd-1c0785701769 tempest-TestInstancesWithCinderVolumes-1394990013 None] Created volume successfully. Jul 03 16:24:25 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae 1073741824" returned: 0 in 1.371s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:25 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae Jul 03 16:24:25 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:25 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (25dcf9d4-f718-4842-9787-5c5c28cd63a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4332989c-bdc2-4e7c-b8b8-3e228aa14579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4332989c-bdc2-4e7c-b8b8-3e228aa14579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-188482155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f59619-2a24-4955-8f5a-1538fca71672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:26Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a9347d-5234-4158-ab69-8edd60214373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a9347d-5234-4158-ab69-8edd60214373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763af0bc-718d-409f-a2d4-17062095ea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763af0bc-718d-409f-a2d4-17062095ea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f59619-2a24-4955-8f5a-1538fca71672', 'volume_name': 'volume-10f59619-2a24-4955-8f5a-1538fca71672', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ddfb94-e84c-49bf-9ce6-e7c7a8e2bf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ddfb94-e84c-49bf-9ce6-e7c7a8e2bf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988490a6-cc43-4623-b623-692ee7b30fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Volume 10f59619-2a24-4955-8f5a-1538fca71672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f59619-2a24-4955-8f5a-1538fca71672', 'volume_size': 1} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD, size 20.69 MB, duration 5.29 sec {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 16:24:26 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Image download 20.69 MB at 3.91 MB/s Jul 03 16:24:26 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae" returned: 0 in 0.955s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.151s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-188482155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f59619-2a24-4955-8f5a-1538fca71672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:26Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Creating volume 10f59619-2a24-4955-8f5a-1538fca71672 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:26 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afdbe88-7fb3-4d3e-93b8-5a2480bcdb91]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:26 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672 1073741824 Jul 03 16:24:26 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae3b4f9-8594-40d5-bf0f-a66c29bbd48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348a0fbd-da80-4571-80fa-774a341c12ae', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162906db-b4e2-4b6e-8e43-6a08539475e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Volume volume-348a0fbd-da80-4571-80fa-774a341c12ae (348a0fbd-da80-4571-80fa-774a341c12ae): created successfully Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162906db-b4e2-4b6e-8e43-6a08539475e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Flow 'volume_create_manager' (ef03a7b7-27c1-4974-bf8d-f7457c7de3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:26 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-615797ea-56ae-45d9-a92b-ec567cfd2693 tempest-VolumesMetadataTest-2068568853 None] Created volume successfully. Jul 03 16:24:26 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD Jul 03 16:24:26 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:27 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD" returned: 0 in 0.913s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:27 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Temporary image bc02be99-c861-4817-9c23-2d227c20da8b is fetched for user 61ed50c4f2684a04b4b51ad1318e0e4f. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 16:24:27 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8186e5-d5ad-433a-b40f-88bf9088f5a9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:27 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672 1073741824" returned: 0 in 1.150s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:27 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672 Jul 03 16:24:27 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:27 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD Jul 03 16:24:27 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:28 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD" returned: 0 in 1.075s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Acquiring lock "cinder-348a0fbd-da80-4571-80fa-774a341c12ae-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Lock "cinder-348a0fbd-da80-4571-80fa-774a341c12ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:28 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672" returned: 0 in 1.129s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.151s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1239273353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209eb3f6-ca26-45f5-a9a8-fa82b7c81ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='069f009af36446df84091c1e6133ac99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:20Z,use_quota=True,user_id='61ed50c4f2684a04b4b51ad1318e0e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8eefe02-b9ba-4340-8e7a-f39c59ed553b),volume_type_id=f8eefe02-b9ba-4340-8e7a-f39c59ed553b)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Creating volume 209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:28 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Acquiring lock "cinder-quobyte-348a0fbd-da80-4571-80fa-774a341c12ae" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:28 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded 1073741824 Jul 03 16:24:28 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988490a6-cc43-4623-b623-692ee7b30fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f59619-2a24-4955-8f5a-1538fca71672', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002728f7-e1cc-48c1-a1f7-ebf29b4fb74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Lock "cinder-quobyte-348a0fbd-da80-4571-80fa-774a341c12ae" acquired by "delete_volume" :: waited 0.043s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:28 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Volume volume-10f59619-2a24-4955-8f5a-1538fca71672 (10f59619-2a24-4955-8f5a-1538fca71672): created successfully Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002728f7-e1cc-48c1-a1f7-ebf29b4fb74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (25dcf9d4-f718-4842-9787-5c5c28cd63a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4afff1-cd4a-4bfd-aa08-6883757d6025]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e7ac97dc-aec6-4f91-9aa8-f1476f880285 tempest-VolumesActionsTest-1580192176 None] Created volume successfully. Jul 03 16:24:28 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae Jul 03 16:24:28 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Acquiring lock "cinder-10f59619-2a24-4955-8f5a-1538fca71672-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Lock "cinder-10f59619-2a24-4955-8f5a-1538fca71672-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Acquiring lock "cinder-quobyte-10f59619-2a24-4955-8f5a-1538fca71672" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Lock "cinder-quobyte-10f59619-2a24-4955-8f5a-1538fca71672" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1498b11c-3241-439a-85d0-8936e01884f2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:29 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded 1073741824" returned: 0 in 1.222s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:29 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672 Jul 03 16:24:29 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:29 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded Jul 03 16:24:29 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:29 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae" returned: 0 in 1.266s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:29 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae Jul 03 16:24:29 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:30 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672" returned: 0 in 1.132s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:30 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672 Jul 03 16:24:30 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:30 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" returned: 0 in 0.965s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] <== create_volume: return (2271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:30 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Attempting download of bc02be99-c861-4817-9c23-2d227c20da8b ((None, [{'url': 'file:///opt/stack/data/glance/images/bc02be99-c861-4817-9c23-2d227c20da8b', 'metadata': {}}])) to volume 209eb3f6-ca26-45f5-a9a8-fa82b7c81ded. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 16:24:30 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0deac97-bb04-4666-86b6-dfea1669cb5d]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc02be99-c861-4817-9c23-2d227c20da8b_4nlnzji7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:31 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-348a0fbd-da80-4571-80fa-774a341c12ae" returned: 0 in 1.096s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Lock "cinder-quobyte-348a0fbd-da80-4571-80fa-774a341c12ae" released by "delete_volume" :: held 2.418s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "cinder-4b5bec88-dd66-4975-aa06-1b2ed1347584-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:31 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc02be99-c861-4817-9c23-2d227c20da8b_4nlnzji7 Jul 03 16:24:31 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-4b5bec88-dd66-4975-aa06-1b2ed1347584-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Created reservations ['d7b61cd1-4fe3-45b0-8e49-f9442c63fef6', 'a567c082-9c60-4510-880e-691df9d1199b', 'f3706619-1378-478a-b61a-5767bf3ffdcb', '5bc5d382-e196-43ce-a09e-9e5763eccf27'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "cinder-quobyte-4b5bec88-dd66-4975-aa06-1b2ed1347584" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-quobyte-4b5bec88-dd66-4975-aa06-1b2ed1347584" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[76445e3c-889a-42dd-a3d6-ed9c5a52398a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:31 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:31 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:31 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 Jul 03 16:24:31 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:31 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-10f59619-2a24-4955-8f5a-1538fca71672" returned: 0 in 0.866s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Lock "cinder-quobyte-10f59619-2a24-4955-8f5a-1538fca71672" released by "delete_volume" :: held 2.107s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Created reservations ['a0d3308b-9e32-4f53-8038-22d0b6376106', '427632d2-95c6-48a2-b334-6f132b6a0410', 'cb5cec48-181f-483b-ba40-6934963b941a', '583e37ba-6d0b-4a07-9699-e7642932aacd'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:31 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc02be99-c861-4817-9c23-2d227c20da8b_4nlnzji7" returned: 0 in 0.898s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc02be99-c861-4817-9c23-2d227c20da8b_4nlnzji7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:31 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:31 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:32 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc02be99-c861-4817-9c23-2d227c20da8b_4nlnzji7 Jul 03 16:24:32 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:32 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.008s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Deleted volume successfully. Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d62c8c16-8f22-43b1-80ae-f8554ecb2861 tempest-VolumesMetadataTest-2068568853 None] Lock "cinder-348a0fbd-da80-4571-80fa-774a341c12ae-delete_volume" released by "delete_volume" :: held 3.851s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:32 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584" returned: 0 in 1.198s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:32 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584 Jul 03 16:24:32 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:32 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.908s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Deleted volume successfully. Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe0932f1-7a12-4e24-be78-0d898fd439af tempest-VolumesActionsTest-1185536327 None] Lock "cinder-10f59619-2a24-4955-8f5a-1538fca71672-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:32 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc02be99-c861-4817-9c23-2d227c20da8b_4nlnzji7" returned: 1 in 1.001s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc02be99-c861-4817-9c23-2d227c20da8b_4nlnzji7' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[75633a8e-65c4-440a-8dd7-cb9a829728b6]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:33 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD Jul 03 16:24:33 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:33 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b5bec88-dd66-4975-aa06-1b2ed1347584" returned: 0 in 0.965s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-quobyte-4b5bec88-dd66-4975-aa06-1b2ed1347584" released by "delete_volume" :: held 2.222s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Created reservations ['4cce23a1-e2f3-4f12-877e-fb71b6efa9b1', 'b42432be-f751-477e-9fe1-64a87a3a4165', '0e2dc59b-c107-40a6-b6c4-74b7b05247a2', '450337e6-4c7a-4967-8885-5113921ba1ce'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:33 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:33 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (5235c055-e268-4c70-9f4c-f94c8eeda8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd40fbfd-ac6b-4613-9c8c-ae216e09b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd40fbfd-ac6b-4613-9c8c-ae216e09b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323400145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c72110-b0cf-48e9-94a2-0be80e58bc70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:34Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917e5649-43ea-429f-951d-c4eb39eae5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917e5649-43ea-429f-951d-c4eb39eae5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450a94d6-4c36-4376-a555-2171eb214ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450a94d6-4c36-4376-a555-2171eb214ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c72110-b0cf-48e9-94a2-0be80e58bc70', 'volume_name': 'volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf3105b-89c6-4926-9758-59b64fcfc8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf3105b-89c6-4926-9758-59b64fcfc8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f217f1-ad84-4b68-ac23-aecc030ca523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:33 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Volume a7c72110-b0cf-48e9-94a2-0be80e58bc70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70', 'volume_size': 1} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323400145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c72110-b0cf-48e9-94a2-0be80e58bc70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:34Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Creating volume a7c72110-b0cf-48e9-94a2-0be80e58bc70 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:33 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:33 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 1073741824 Jul 03 16:24:33 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:34 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD" returned: 0 in 1.188s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] bc02be99-c861-4817-9c23-2d227c20da8b was qcow2, converting to raw {{(pid=86659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:34 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded Jul 03 16:24:34 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:34 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.792s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Deleted volume successfully. Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ba1e5738-1451-4c5c-b75c-4dd6c9429eed tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-4b5bec88-dd66-4975-aa06-1b2ed1347584-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "cinder-a60d244b-c4fa-482d-9bb2-e31bb61ae354-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-a60d244b-c4fa-482d-9bb2-e31bb61ae354-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "cinder-quobyte-a60d244b-c4fa-482d-9bb2-e31bb61ae354" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-quobyte-a60d244b-c4fa-482d-9bb2-e31bb61ae354" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc322d6c-8328-4115-824b-3b478ee3010f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:34 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 Jul 03 16:24:34 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:35 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 1073741824" returned: 0 in 1.226s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:35 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 Jul 03 16:24:35 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:35 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354" returned: 0 in 1.193s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:36 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354 Jul 03 16:24:36 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:36 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70" returned: 0 in 0.903s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f217f1-ad84-4b68-ac23-aecc030ca523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e372d62-f121-4ad8-bf8d-64006b4ac4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:36 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Volume volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 (a7c72110-b0cf-48e9-94a2-0be80e58bc70): created successfully Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e372d62-f121-4ad8-bf8d-64006b4ac4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (5235c055-e268-4c70-9f4c-f94c8eeda8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:36 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f9d5459a-9a0e-477f-b3c0-739d32092cc5 tempest-VolumesActionsTest-1580192176 None] Created volume successfully. Jul 03 16:24:36 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" returned: 0 in 2.639s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bc02be99-c861-4817-9c23-2d227c20da8b_c4rxqpbrdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:24:36 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Converted 112.00 MB image at 42.43 MB/s Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:36 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded 1G Jul 03 16:24:36 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:36 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a60d244b-c4fa-482d-9bb2-e31bb61ae354" returned: 0 in 0.893s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-quobyte-a60d244b-c4fa-482d-9bb2-e31bb61ae354" released by "delete_volume" :: held 2.166s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Created reservations ['9dda52f6-1fda-4262-96a8-c407d2be84ad', '5ed9a6a9-5bf4-4152-b2a1-59034d4a8864', '9ca84c84-cc8e-4f3f-9463-4ef7e328f54f', '9794a1bd-f78d-4300-aba7-922fccdbf3a4'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:37 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:37 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Acquiring lock "cinder-a7c72110-b0cf-48e9-94a2-0be80e58bc70-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Lock "cinder-a7c72110-b0cf-48e9-94a2-0be80e58bc70-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Acquiring lock "cinder-quobyte-a7c72110-b0cf-48e9-94a2-0be80e58bc70" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Lock "cinder-quobyte-a7c72110-b0cf-48e9-94a2-0be80e58bc70" acquired by "delete_volume" :: waited 0.046s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4f35b0-8ddc-4916-90eb-a8b2d0310809]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:37 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 Jul 03 16:24:37 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:37 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded 1G" returned: 0 in 0.914s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a65e563-e7c1-4c5d-9f97-8dcc26998d46]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:37 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded Jul 03 16:24:37 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:37 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.794s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Deleted volume successfully. Jul 03 16:24:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f90d1e33-1cbd-43f7-86b3-5dcc64357bad tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-a60d244b-c4fa-482d-9bb2-e31bb61ae354-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "cinder-b64dd718-97d6-4ed1-90c7-3a380cd0863d-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:38 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70" returned: 0 in 1.118s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-b64dd718-97d6-4ed1-90c7-3a380cd0863d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:38 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70 Jul 03 16:24:38 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "cinder-quobyte-b64dd718-97d6-4ed1-90c7-3a380cd0863d" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-quobyte-b64dd718-97d6-4ed1-90c7-3a380cd0863d" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa9ffbb-5d47-4d1f-881d-4f4650bc5a32]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:38 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" returned: 0 in 0.985s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Flow 'volume_create_manager' (e8cb07a4-2277-440c-97e0-7b98814e48bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:38 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d Jul 03 16:24:38 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e8eeeb-6918-495e-9e4c-e21628766d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e8eeeb-6918-495e-9e4c-e21628766d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-793696187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8ee82b-748c-43d7-867e-f26f74ce9e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9802b7d5e9c4405d9baa483ac83fd01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:39Z,use_quota=True,user_id='92a443dd6d0c41ec827b7e8a96f3b7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a32b767-a0dc-4a73-9c6c-b669f80e6b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a32b767-a0dc-4a73-9c6c-b669f80e6b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835fc223-8a33-4245-9854-2cdbd29c42f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835fc223-8a33-4245-9854-2cdbd29c42f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8ee82b-748c-43d7-867e-f26f74ce9e30', 'volume_name': 'volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ebe22a-6b71-422a-887c-b5a9dee9396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:38 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ebe22a-6b71-422a-887c-b5a9dee9396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:38 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b16ee9-9cfd-4373-a34e-a2444136461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Volume cc8ee82b-748c-43d7-867e-f26f74ce9e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30', 'volume_size': 1} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-793696187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8ee82b-748c-43d7-867e-f26f74ce9e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9802b7d5e9c4405d9baa483ac83fd01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:39Z,use_quota=True,user_id='92a443dd6d0c41ec827b7e8a96f3b7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Creating volume cc8ee82b-748c-43d7-867e-f26f74ce9e30 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:38 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:38 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 1073741824 Jul 03 16:24:38 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:39 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a7c72110-b0cf-48e9-94a2-0be80e58bc70" returned: 0 in 0.814s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Lock "cinder-quobyte-a7c72110-b0cf-48e9-94a2-0be80e58bc70" released by "delete_volume" :: held 1.994s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Created reservations ['1475b660-1fcd-4fb4-989a-098236a02fa2', 'e13cff50-1c57-408e-83c7-4229518d57ef', '1b833042-786f-4457-8c03-3ff24e7a4f98', 'da8823bd-1169-4b7d-972d-9becd3f2d2a7'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:39 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:39 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:39 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d" returned: 0 in 0.979s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:39 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:39 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d Jul 03 16:24:39 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" returned: 1 in 1.013s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Downloaded image bc02be99-c861-4817-9c23-2d227c20da8b ((None, [{'url': 'file:///opt/stack/data/glance/images/bc02be99-c861-4817-9c23-2d227c20da8b', 'metadata': {}}])) to volume 209eb3f6-ca26-45f5-a9a8-fa82b7c81ded successfully. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Temporary image bc02be99-c861-4817-9c23-2d227c20da8b for user 61ed50c4f2684a04b4b51ad1318e0e4f is deleted. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Marking volume 209eb3f6-ca26-45f5-a9a8-fa82b7c81ded as bootable. {{(pid=86659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Copying metadata from image bc02be99-c861-4817-9c23-2d227c20da8b to 209eb3f6-ca26-45f5-a9a8-fa82b7c81ded. {{(pid=86659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Creating volume glance metadata for volume 209eb3f6-ca26-45f5-a9a8-fa82b7c81ded backed by image bc02be99-c861-4817-9c23-2d227c20da8b with: {'image_id': 'bc02be99-c861-4817-9c23-2d227c20da8b', 'image_name': 'tempest-scenario-img--1724710558', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dea7e1e-3cc2-467e-9335-df6cf935451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded', 'volume_size': 1, 'image_id': 'bc02be99-c861-4817-9c23-2d227c20da8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc02be99-c861-4817-9c23-2d227c20da8b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1724710558', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '069f009af36446df84091c1e6133ac99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bc02be99-c861-4817-9c23-2d227c20da8b', 'created_at': datetime.datetime(2026, 7, 3, 14, 24, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 24, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc02be99-c861-4817-9c23-2d227c20da8b/file', 'properties': {}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268d623b-e408-44cd-96f1-30b4ee570e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:39 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Volume volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded (209eb3f6-ca26-45f5-a9a8-fa82b7c81ded): created successfully Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268d623b-e408-44cd-96f1-30b4ee570e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Flow 'volume_create_manager' (31c4bce0-5216-4ebf-8598-11809b02e656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-86d7e805-51e1-449d-b4d2-d036c5a550fa tempest-TestInstancesWithCinderVolumes-1394990013 None] Created volume successfully. Jul 03 16:24:40 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 1073741824" returned: 0 in 1.230s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:40 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 Jul 03 16:24:40 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:40 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (3e6e1ea3-5a85-48fe-9803-75aff5a04cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604fe6e4-ecc4-44f3-becd-5211f5657cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.888s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:40 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Deleted volume successfully. Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604fe6e4-ecc4-44f3-becd-5211f5657cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-419517919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2840df5-22ad-480f-8c6f-809b8a9f2300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:40Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2027100-91da-44e5-afc2-5da9f7a22efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2027100-91da-44e5-afc2-5da9f7a22efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957707ce-d820-4b9c-97ee-f76f1a727460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957707ce-d820-4b9c-97ee-f76f1a727460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2840df5-22ad-480f-8c6f-809b8a9f2300', 'volume_name': 'volume-b2840df5-22ad-480f-8c6f-809b8a9f2300', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c577ce-d013-47ec-a928-77494bfe5508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c577ce-d013-47ec-a928-77494bfe5508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea3c01a-8df3-465f-81b7-f45f2d6b8cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:40 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Volume b2840df5-22ad-480f-8c6f-809b8a9f2300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2840df5-22ad-480f-8c6f-809b8a9f2300', 'volume_size': 1} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:40 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b64dd718-97d6-4ed1-90c7-3a380cd0863d" returned: 0 in 0.899s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4bd5fdc8-e618-4064-bd10-c16b9ce67c53 tempest-VolumesActionsTest-1185536327 None] Lock "cinder-a7c72110-b0cf-48e9-94a2-0be80e58bc70-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-quobyte-b64dd718-97d6-4ed1-90c7-3a380cd0863d" released by "delete_volume" :: held 1.918s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Created reservations ['2d893ecb-8831-45cc-b937-aabec8425df2', 'bd34fb1d-9dca-4d84-b0fc-c7eed52cc681', '55d89484-d730-4617-98b1-cc68a84b47e3', '1fd503ee-360a-4ad3-9ce8-396109e91245'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:40 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:40 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:40 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30" returned: 0 in 0.869s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-419517919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2840df5-22ad-480f-8c6f-809b8a9f2300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:40Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Creating volume b2840df5-22ad-480f-8c6f-809b8a9f2300 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:40 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:41 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 1073741824 Jul 03 16:24:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b16ee9-9cfd-4373-a34e-a2444136461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:41 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e53c50f-dde3-41f6-897b-39a1dd4527c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:41 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Volume volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 (cc8ee82b-748c-43d7-867e-f26f74ce9e30): created successfully Jul 03 16:24:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e53c50f-dde3-41f6-897b-39a1dd4527c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Flow 'volume_create_manager' (e8cb07a4-2277-440c-97e0-7b98814e48bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:41 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-352f9007-573c-450a-9bd5-0277f41370da tempest-VolumesTransfersV355Test-805787777 None] Created volume successfully. Jul 03 16:24:41 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.833s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:41 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:41 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Deleted volume successfully. Jul 03 16:24:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3477bdb8-6de0-490e-ad2c-e1b8ae8324cd tempest-AttachVolumeNegativeTest-2091901602 None] Lock "cinder-b64dd718-97d6-4ed1-90c7-3a380cd0863d-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:42 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 1073741824" returned: 0 in 1.405s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:42 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 Jul 03 16:24:42 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:42 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ff21e8bb-46f2-4fb7-88d3-e4b33befa1e8 tempest-VolumesTransfersV355Test-617075845 None] Transfer volume completed successfully. Jul 03 16:24:43 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300" returned: 0 in 0.763s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea3c01a-8df3-465f-81b7-f45f2d6b8cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2840df5-22ad-480f-8c6f-809b8a9f2300', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5244c3a2-c11d-465b-8218-779d0d6e1a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:43 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Volume volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 (b2840df5-22ad-480f-8c6f-809b8a9f2300): created successfully Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5244c3a2-c11d-465b-8218-779d0d6e1a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (3e6e1ea3-5a85-48fe-9803-75aff5a04cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:43 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d5495adc-f816-46da-8f11-fc0a1137b491 tempest-VolumesActionsTest-1580192176 None] Created volume successfully. Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Acquiring lock "cinder-b2840df5-22ad-480f-8c6f-809b8a9f2300-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Lock "cinder-b2840df5-22ad-480f-8c6f-809b8a9f2300-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Acquiring lock "cinder-quobyte-b2840df5-22ad-480f-8c6f-809b8a9f2300" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Lock "cinder-quobyte-b2840df5-22ad-480f-8c6f-809b8a9f2300" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[df07f352-1d83-4d4c-8c26-131d552dbbec]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Acquiring lock "cinder-cc8ee82b-748c-43d7-867e-f26f74ce9e30-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Lock "cinder-cc8ee82b-748c-43d7-867e-f26f74ce9e30-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Acquiring lock "cinder-quobyte-cc8ee82b-748c-43d7-867e-f26f74ce9e30" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Lock "cinder-quobyte-cc8ee82b-748c-43d7-867e-f26f74ce9e30" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:44 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 Jul 03 16:24:44 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[58601c81-4e43-466b-9a57-7e3b6637f8c1]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:44 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 Jul 03 16:24:44 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:44 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300" returned: 0 in 0.972s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:45 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300 Jul 03 16:24:45 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:45 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30" returned: 0 in 1.117s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:45 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30 Jul 03 16:24:45 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:45 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b2840df5-22ad-480f-8c6f-809b8a9f2300" returned: 0 in 0.847s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Lock "cinder-quobyte-b2840df5-22ad-480f-8c6f-809b8a9f2300" released by "delete_volume" :: held 1.891s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:45 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Created reservations ['94b7655a-04fd-4fc6-9a1b-3d3f63306f2f', 'c0849b53-aaeb-4112-9394-a6c66c9fa834', 'd958bc36-c426-456e-82e6-5564e1f960c3', '7f348aca-cd66-4273-96a1-2a022c8868a1'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:46 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:46 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:46 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cc8ee82b-748c-43d7-867e-f26f74ce9e30" returned: 0 in 0.831s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Lock "cinder-quobyte-cc8ee82b-748c-43d7-867e-f26f74ce9e30" released by "delete_volume" :: held 2.009s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Created reservations ['6ade9627-6cc3-408d-ad19-2be7df70bcdf', '57ad13d6-11ac-4a1b-bc3d-98300bfcf098', 'adf4e4ae-8823-404c-9e8c-120d13fd693f', '8c54cf7b-8bf1-4a34-9ebc-a645160a9e3f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:46 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:46 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (1bafe752-8bb5-411c-9c17-3662936815c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c13598-1793-4c90-a8ec-f78c44f884d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c13598-1793-4c90-a8ec-f78c44f884d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-728858471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3242a5c9-b739-4244-9404-583b59dc14df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:47Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44c349a-5909-4356-af90-b02fe738bb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44c349a-5909-4356-af90-b02fe738bb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440a2c48-d11d-4d82-832d-9947107298eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440a2c48-d11d-4d82-832d-9947107298eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3242a5c9-b739-4244-9404-583b59dc14df', 'volume_name': 'volume-3242a5c9-b739-4244-9404-583b59dc14df', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f48f92d-d46f-44e6-bfaa-a04cdb92b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f48f92d-d46f-44e6-bfaa-a04cdb92b88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee880d1-f8f4-4912-8b67-689baaac1205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Volume 3242a5c9-b739-4244-9404-583b59dc14df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3242a5c9-b739-4244-9404-583b59dc14df', 'volume_size': 1} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-728858471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3242a5c9-b739-4244-9404-583b59dc14df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:47Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Creating volume 3242a5c9-b739-4244-9404-583b59dc14df {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:47 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:47 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df 1073741824 Jul 03 16:24:47 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:47 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.512s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:47 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:47 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Deleted volume successfully. Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.228s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:47 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Deleted volume successfully. Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7783ed49-9732-493e-99cb-f28f8bbf8bfd tempest-VolumesActionsTest-1185536327 None] Lock "cinder-b2840df5-22ad-480f-8c6f-809b8a9f2300-delete_volume" released by "delete_volume" :: held 3.770s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5b5e8bc2-d2f6-4638-99a9-11aa9f512ab6 tempest-VolumesTransfersV355Test-1166567167 None] Lock "cinder-cc8ee82b-748c-43d7-867e-f26f74ce9e30-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Flow 'volume_create_manager' (aaca0fee-c212-4b1d-a0c5-d97bdb1c83ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ea3fdf-0208-413d-8425-27aa9382fa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ea3fdf-0208-413d-8425-27aa9382fa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1584297767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762f841f-e476-4900-859b-b25154271580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9802b7d5e9c4405d9baa483ac83fd01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:48Z,use_quota=True,user_id='92a443dd6d0c41ec827b7e8a96f3b7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cfc01c-300a-48ea-8993-597bb8520c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cfc01c-300a-48ea-8993-597bb8520c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73eb9a8d-1b3b-4361-8556-f9cdd3349548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73eb9a8d-1b3b-4361-8556-f9cdd3349548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762f841f-e476-4900-859b-b25154271580', 'volume_name': 'volume-762f841f-e476-4900-859b-b25154271580', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8731c7b-9acc-4157-a951-0f544391d3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8731c7b-9acc-4157-a951-0f544391d3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676a48c8-6196-4d87-b31d-45e944f295a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:47 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Volume 762f841f-e476-4900-859b-b25154271580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762f841f-e476-4900-859b-b25154271580', 'volume_size': 1} Jul 03 16:24:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:48 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df 1073741824" returned: 0 in 1.074s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:48 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df Jul 03 16:24:48 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:49 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df" returned: 0 in 0.964s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1584297767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762f841f-e476-4900-859b-b25154271580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9802b7d5e9c4405d9baa483ac83fd01d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:48Z,use_quota=True,user_id='92a443dd6d0c41ec827b7e8a96f3b7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Creating volume 762f841f-e476-4900-859b-b25154271580 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:49 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:49 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580 1073741824 Jul 03 16:24:49 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee880d1-f8f4-4912-8b67-689baaac1205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3242a5c9-b739-4244-9404-583b59dc14df', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f211b8-47d0-4311-bb0b-8ef414cb797b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:49 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Volume volume-3242a5c9-b739-4244-9404-583b59dc14df (3242a5c9-b739-4244-9404-583b59dc14df): created successfully Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f211b8-47d0-4311-bb0b-8ef414cb797b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (1bafe752-8bb5-411c-9c17-3662936815c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c1009381-0a37-4256-8fb3-eb61de949b4f tempest-VolumesActionsTest-1580192176 None] Created volume successfully. Jul 03 16:24:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Acquiring lock "cinder-3242a5c9-b739-4244-9404-583b59dc14df-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Lock "cinder-3242a5c9-b739-4244-9404-583b59dc14df-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Acquiring lock "cinder-quobyte-3242a5c9-b739-4244-9404-583b59dc14df" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Lock "cinder-quobyte-3242a5c9-b739-4244-9404-583b59dc14df" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[34522f03-9c59-4235-a8a4-89b965388fad]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:50 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df Jul 03 16:24:50 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:51 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580 1073741824" returned: 0 in 1.411s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:51 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580 Jul 03 16:24:51 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Flow 'volume_create_manager' (d06be656-7d39-4a94-ae06-ac1c493e5727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6aca3e-5800-4f80-a419-40532269cc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6aca3e-5800-4f80-a419-40532269cc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-301580965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da3c629-1cd6-4ca8-afa7-bb40e109c049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba4ec3d2b29444c78e8a0ada17bf94fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:52Z,use_quota=True,user_id='81e7a07cd82a42c692cfc9fa4727ada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee27468-dfe9-41be-96a2-3898ab4dcaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee27468-dfe9-41be-96a2-3898ab4dcaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb13ba4e-8dae-4c3d-ab6f-231f6d5a361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb13ba4e-8dae-4c3d-ab6f-231f6d5a361b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da3c629-1cd6-4ca8-afa7-bb40e109c049', 'volume_name': 'volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ecd7e6-7004-4444-8785-75fd4a944bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ecd7e6-7004-4444-8785-75fd4a944bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b55db3-e09a-4819-9da6-e78e791c5ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Volume 0da3c629-1cd6-4ca8-afa7-bb40e109c049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049', 'volume_size': 1} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:51 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df" returned: 0 in 1.169s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:51 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df Jul 03 16:24:51 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:52 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580" returned: 0 in 1.112s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] <== create_volume: return (2629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.634s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.929s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676a48c8-6196-4d87-b31d-45e944f295a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762f841f-e476-4900-859b-b25154271580', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687972a0-4014-4cb3-b119-e0ed719e9de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:52 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Volume volume-762f841f-e476-4900-859b-b25154271580 (762f841f-e476-4900-859b-b25154271580): created successfully Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687972a0-4014-4cb3-b119-e0ed719e9de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Flow 'volume_create_manager' (aaca0fee-c212-4b1d-a0c5-d97bdb1c83ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[28833010-4b57-4c97-a15c-5fbc0aea796b]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:52 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-951b80d0-2a9d-4993-acfc-322bbe8cb5b0 tempest-VolumesTransfersV355Test-805787777 None] Created volume successfully. Jul 03 16:24:52 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded Jul 03 16:24:52 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:52 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3242a5c9-b739-4244-9404-583b59dc14df" returned: 0 in 0.786s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Lock "cinder-quobyte-3242a5c9-b739-4244-9404-583b59dc14df" released by "delete_volume" :: held 2.037s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Created reservations ['99227c69-b63c-4191-a88f-06cd6dee6612', '95ffb856-64f0-4831-824e-88e73b3540c8', 'd258e8e7-21aa-491a-baf3-b72deec5bb26', '4e7ccdf6-e891-4b5d-b5f8-a19f225377f8'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:52 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:52 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:53 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" returned: 0 in 0.931s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Acquiring lock "cinder-762f841f-e476-4900-859b-b25154271580-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Lock "cinder-762f841f-e476-4900-859b-b25154271580-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Acquiring lock "cinder-quobyte-762f841f-e476-4900-859b-b25154271580" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Lock "cinder-quobyte-762f841f-e476-4900-859b-b25154271580" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:53 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded Jul 03 16:24:53 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fbeef9-1fdb-4d3b-89c9-742c6240299d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:53 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580 Jul 03 16:24:53 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:53 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.897s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Deleted volume successfully. Jul 03 16:24:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7d48a28-e833-4905-a5a2-1179a21ece59 tempest-VolumesActionsTest-1185536327 None] Lock "cinder-3242a5c9-b739-4244-9404-583b59dc14df-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:54 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" returned: 1 in 0.977s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.995s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.381s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-301580965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da3c629-1cd6-4ca8-afa7-bb40e109c049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba4ec3d2b29444c78e8a0ada17bf94fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:52Z,use_quota=True,user_id='81e7a07cd82a42c692cfc9fa4727ada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Creating volume 0da3c629-1cd6-4ca8-afa7-bb40e109c049 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:54 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:54 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 1073741824 Jul 03 16:24:54 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14095cb9-3f88-40c6-8857-cdc0d21f5c68', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:24:54 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-c93deab9-45c0-4f01-9ce2-2d2c9c03cd38 req-9129814b-8f64-46d3-88d7-a73358d16c72 tempest-TestInstancesWithCinderVolumes-1394990013 None] attachment_update completed successfully. Jul 03 16:24:54 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580" returned: 0 in 1.075s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:54 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580 Jul 03 16:24:54 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (54c575cc-e108-4d75-b41f-55a3494494c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cce7291-7808-4b9f-9c6e-943c8ecc6208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cce7291-7808-4b9f-9c6e-943c8ecc6208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1810574305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388eec54-82d9-49e1-98e2-3f082d63f3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:55Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e083e4-014d-490c-8358-2a232e32db73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e083e4-014d-490c-8358-2a232e32db73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d7d0b-16d1-4ec5-b872-5b625340f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d7d0b-16d1-4ec5-b872-5b625340f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388eec54-82d9-49e1-98e2-3f082d63f3bb', 'volume_name': 'volume-388eec54-82d9-49e1-98e2-3f082d63f3bb', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79574417-775a-4681-995e-304c75b77021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79574417-775a-4681-995e-304c75b77021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9d4eac-a150-4971-99c5-b09df64421b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:54 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Volume 388eec54-82d9-49e1-98e2-3f082d63f3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388eec54-82d9-49e1-98e2-3f082d63f3bb', 'volume_size': 1} Jul 03 16:24:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:55 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-762f841f-e476-4900-859b-b25154271580" returned: 0 in 0.722s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Lock "cinder-quobyte-762f841f-e476-4900-859b-b25154271580" released by "delete_volume" :: held 1.879s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:55 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 1073741824" returned: 0 in 1.047s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Created reservations ['b9b70c73-5862-49dc-b3ee-6c3aa9c13a1c', 'dabcf345-5a23-4520-8300-a198d69d2f77', '1964ea63-729c-447d-a273-d78be666d71c', 'c62e0111-1a1d-4b0b-b26b-fb68b2cedd5e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:24:55 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 Jul 03 16:24:55 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:55 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:24:55 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:56 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049" returned: 0 in 0.786s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1810574305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388eec54-82d9-49e1-98e2-3f082d63f3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63873a2a55640e2ab34d31a5a98cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:24:55Z,use_quota=True,user_id='0e6eb143ebc04feeb1ce331e78388fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Creating volume 388eec54-82d9-49e1-98e2-3f082d63f3bb {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:24:56 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:56 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb 1073741824 Jul 03 16:24:56 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b55db3-e09a-4819-9da6-e78e791c5ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d49a63c-f483-40cb-a1ce-88e84fab648c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:56 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Volume volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 (0da3c629-1cd6-4ca8-afa7-bb40e109c049): created successfully Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d49a63c-f483-40cb-a1ce-88e84fab648c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Flow 'volume_create_manager' (d06be656-7d39-4a94-ae06-ac1c493e5727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:56 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-3424c982-52ae-487f-9bd0-6f349efcadae req-25769600-d316-42be-9188-814a5a4d5c0d tempest-VolumesGetTestJSON-1928091584 None] Created volume successfully. Jul 03 16:24:56 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.804s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:24:56 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Deleted volume successfully. Jul 03 16:24:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e27729dd-1650-4798-b6e9-2f3bd9c2af0d tempest-VolumesTransfersV355Test-1166567167 None] Lock "cinder-762f841f-e476-4900-859b-b25154271580-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:24:57 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb 1073741824" returned: 0 in 1.137s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:57 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb Jul 03 16:24:57 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Acquiring lock "cinder-0da3c629-1cd6-4ca8-afa7-bb40e109c049-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Lock "cinder-0da3c629-1cd6-4ca8-afa7-bb40e109c049-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=171,cinder:SELECT=110,cinder:DELETE=13,cinder:INSERT=43 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=140,cinder:UPDATE=149,cinder:DELETE=14,cinder:INSERT=38 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Acquiring lock "cinder-quobyte-0da3c629-1cd6-4ca8-afa7-bb40e109c049" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Lock "cinder-quobyte-0da3c629-1cd6-4ca8-afa7-bb40e109c049" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3b3bde-3454-430b-aa33-4b32c2421e97]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:24:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:58 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 Jul 03 16:24:58 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:24:58 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb" returned: 0 in 0.922s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:24:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:24:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9d4eac-a150-4971-99c5-b09df64421b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388eec54-82d9-49e1-98e2-3f082d63f3bb', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce77d6-b5ce-4e50-9df5-03461e5c9a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:24:58 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Volume volume-388eec54-82d9-49e1-98e2-3f082d63f3bb (388eec54-82d9-49e1-98e2-3f082d63f3bb): created successfully Jul 03 16:24:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce77d6-b5ce-4e50-9df5-03461e5c9a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:24:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Flow 'volume_create_manager' (54c575cc-e108-4d75-b41f-55a3494494c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:24:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fef355fb-526c-41b3-bc91-d6d497a09ca8 tempest-VolumesActionsTest-1580192176 None] Created volume successfully. Jul 03 16:24:58 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 03 16:24:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049" returned: 0 in 1.026s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:24:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:24:59 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049 Jul 03 16:24:59 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Acquiring lock "cinder-388eec54-82d9-49e1-98e2-3f082d63f3bb-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Lock "cinder-388eec54-82d9-49e1-98e2-3f082d63f3bb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Acquiring lock "cinder-quobyte-388eec54-82d9-49e1-98e2-3f082d63f3bb" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Lock "cinder-quobyte-388eec54-82d9-49e1-98e2-3f082d63f3bb" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:00 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0da3c629-1cd6-4ca8-afa7-bb40e109c049" returned: 0 in 1.268s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Lock "cinder-quobyte-0da3c629-1cd6-4ca8-afa7-bb40e109c049" released by "delete_volume" :: held 2.381s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdb870d-4c6b-4565-8fd4-635033fdf4ea]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG cinder.quota [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Created reservations ['dc5c0513-edeb-4570-8b57-43c6bae84068', '6a0b4ca9-8a94-494f-b284-d402618e7f29', '9d802b05-8a40-4602-bd56-cc87197d57a9', '40855389-36e7-4bda-96d9-cf062bf39b2e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:00 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:25:00 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:00 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb Jul 03 16:25:00 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:01 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb" returned: 0 in 1.487s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:01 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb Jul 03 16:25:01 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:01 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.505s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:02 devstack cinder-volume[86659]: DEBUG cinder.manager [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:25:02 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Deleted volume successfully. Jul 03 16:25:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-3b16ba46-4b5f-48b4-844e-45344b4349c5 req-20278c24-107f-45d2-a44f-e9095cb20024 tempest-VolumesGetTestJSON-1928091584 None] Lock "cinder-0da3c629-1cd6-4ca8-afa7-bb40e109c049-delete_volume" released by "delete_volume" :: held 4.394s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:03 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-388eec54-82d9-49e1-98e2-3f082d63f3bb" returned: 0 in 1.424s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Lock "cinder-quobyte-388eec54-82d9-49e1-98e2-3f082d63f3bb" released by "delete_volume" :: held 2.999s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:03 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Created reservations ['7db6b6ea-2b81-46d1-8527-aba6e885b474', '1eaa3b58-5394-4160-baaf-465b8e08567e', '8f00a389-1bd4-4a4e-ad97-641260062880', '60e234a4-6c5b-4adf-8c37-f4ba70aad4ad'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:25:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:03 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:25:03 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:04 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.508s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:04 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:25:04 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Deleted volume successfully. Jul 03 16:25:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-848734f0-c25f-46aa-8b4e-513f28a975ea tempest-VolumesActionsTest-1580192176 None] Lock "cinder-388eec54-82d9-49e1-98e2-3f082d63f3bb-delete_volume" released by "delete_volume" :: held 4.958s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Flow 'volume_create_manager' (da72d4c5-219d-4109-b8a5-7cba09e95aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb85123a-bb45-43fe-a95f-50dbe2aa5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb85123a-bb45-43fe-a95f-50dbe2aa5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-105241649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04561909-6e6d-4640-b082-8ebe820bdd31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fde74fcb194ecaa98a0aa64d62a543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:06Z,use_quota=True,user_id='b74cb0e100644075bb9ca53fd411e154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b140f05-f8d6-4990-84d7-72a6d151d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b140f05-f8d6-4990-84d7-72a6d151d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70694aa5-9292-46f5-8613-1880be7ea2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70694aa5-9292-46f5-8613-1880be7ea2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04561909-6e6d-4640-b082-8ebe820bdd31', 'volume_name': 'volume-04561909-6e6d-4640-b082-8ebe820bdd31', 'volume_size': 2}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44a9f75-4f83-4f30-a419-4314170bc3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44a9f75-4f83-4f30-a419-4314170bc3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a756c966-a9e3-487b-b3b0-e2deab41e3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:06 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Volume 04561909-6e6d-4640-b082-8ebe820bdd31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04561909-6e6d-4640-b082-8ebe820bdd31', 'volume_size': 2} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-105241649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04561909-6e6d-4640-b082-8ebe820bdd31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fde74fcb194ecaa98a0aa64d62a543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:06Z,use_quota=True,user_id='b74cb0e100644075bb9ca53fd411e154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Creating volume 04561909-6e6d-4640-b082-8ebe820bdd31 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:25:06 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:25:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31 2147483648 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:06 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31 2147483648 Jul 03 16:25:06 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:08 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31 2147483648" returned: 0 in 1.867s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:08 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31 Jul 03 16:25:08 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:10 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31" returned: 0 in 1.848s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] <== create_volume: return (3824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:25:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.833s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a756c966-a9e3-487b-b3b0-e2deab41e3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04561909-6e6d-4640-b082-8ebe820bdd31', 'volume_size': 2}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdd63fe-1404-4c9f-a52f-8e2170331bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Volume volume-04561909-6e6d-4640-b082-8ebe820bdd31 (04561909-6e6d-4640-b082-8ebe820bdd31): created successfully Jul 03 16:25:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdd63fe-1404-4c9f-a52f-8e2170331bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Flow 'volume_create_manager' (da72d4c5-219d-4109-b8a5-7cba09e95aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:10 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-5a832b32-2e0c-408a-8210-3db65646f1ee tempest-VolumesCloneNegativeTest-1734756136 None] Created volume successfully. Jul 03 16:25:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Acquiring lock "cinder-04561909-6e6d-4640-b082-8ebe820bdd31-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Lock "cinder-04561909-6e6d-4640-b082-8ebe820bdd31-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Acquiring lock "cinder-quobyte-04561909-6e6d-4640-b082-8ebe820bdd31" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Lock "cinder-quobyte-04561909-6e6d-4640-b082-8ebe820bdd31" acquired by "delete_volume" :: waited 0.043s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:11 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[80890286-6028-4ed6-95d2-4d9196bbf03b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:11 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31 Jul 03 16:25:11 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Flow 'volume_create_manager' (14ccf3ab-2b28-45a3-be7e-f0c3417fa82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f51c7b-33fb-42f2-b578-5b83d2a07579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f51c7b-33fb-42f2-b578-5b83d2a07579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1177290588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5aaa029-7a96-467d-b0b3-d110144e19c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7844c8f03e7f44b59e1f89f3e3b4c53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:12Z,use_quota=True,user_id='d1df8a8be0954171ac5835cfc232fa71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad4e70e-80b3-475f-8d9e-66331c8ea973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad4e70e-80b3-475f-8d9e-66331c8ea973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac22174-5fc7-4f09-8568-89ac5f774ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac22174-5fc7-4f09-8568-89ac5f774ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5aaa029-7a96-467d-b0b3-d110144e19c3', 'volume_name': 'volume-b5aaa029-7a96-467d-b0b3-d110144e19c3', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f2098e-c088-492f-bc6b-aed06ce3c5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f2098e-c088-492f-bc6b-aed06ce3c5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560eaf00-cd32-4f48-aa92-3ff2584f6f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:12 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Volume b5aaa029-7a96-467d-b0b3-d110144e19c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5aaa029-7a96-467d-b0b3-d110144e19c3', 'volume_size': 1} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1177290588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5aaa029-7a96-467d-b0b3-d110144e19c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7844c8f03e7f44b59e1f89f3e3b4c53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:12Z,use_quota=True,user_id='d1df8a8be0954171ac5835cfc232fa71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Creating volume b5aaa029-7a96-467d-b0b3-d110144e19c3 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:25:12 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:25:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:12 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 1073741824 Jul 03 16:25:12 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:13 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31" returned: 0 in 1.770s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:13 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31 Jul 03 16:25:13 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:14 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 1073741824" returned: 0 in 1.632s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:14 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 Jul 03 16:25:14 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:14 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04561909-6e6d-4640-b082-8ebe820bdd31" returned: 0 in 1.314s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Lock "cinder-quobyte-04561909-6e6d-4640-b082-8ebe820bdd31" released by "delete_volume" :: held 3.191s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:14 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Created reservations ['f7a98e52-8d82-4be6-96e5-af663a40b9e2', '8823d650-406a-424f-983b-41736f17718c', 'd1ff55e2-d806-4823-b686-11dc4e7ff3e5', '65cef034-0a24-4c5d-bcb5-21c399b820ab'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:25:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:15 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:25:15 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:15 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3" returned: 0 in 1.116s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] <== create_volume: return (2914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:25:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.921s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560eaf00-cd32-4f48-aa92-3ff2584f6f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5aaa029-7a96-467d-b0b3-d110144e19c3', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b933ed19-718e-4741-a9f2-9e23678e9a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:15 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Volume volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 (b5aaa029-7a96-467d-b0b3-d110144e19c3): created successfully Jul 03 16:25:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b933ed19-718e-4741-a9f2-9e23678e9a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Flow 'volume_create_manager' (14ccf3ab-2b28-45a3-be7e-f0c3417fa82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-30f87ce7-a385-431b-bf13-7ee38b33fd1b tempest-VolumesTestJSON-1246871758 None] Created volume successfully. Jul 03 16:25:16 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.194s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:16 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:25:16 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Deleted volume successfully. Jul 03 16:25:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bce47ad6-9546-4b37-9fe2-dbe2e0b9e686 tempest-VolumesCloneNegativeTest-1734756136 None] Lock "cinder-04561909-6e6d-4640-b082-8ebe820bdd31-delete_volume" released by "delete_volume" :: held 4.969s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Flow 'volume_create_manager' (d0fb5799-446c-4273-848c-4b8d84ed3386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c978aa4-76d5-4234-88e7-1540d61e5858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c978aa4-76d5-4234-88e7-1540d61e5858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1583372398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e39b1cf-3418-4ff7-8a41-ffa7c655de5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7844c8f03e7f44b59e1f89f3e3b4c53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:18Z,use_quota=True,user_id='d1df8a8be0954171ac5835cfc232fa71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e604b9-4f93-4b2a-8c88-2dc1e9ffb677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e604b9-4f93-4b2a-8c88-2dc1e9ffb677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de55afd0-2177-4005-a217-0bcbe08052a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de55afd0-2177-4005-a217-0bcbe08052a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e39b1cf-3418-4ff7-8a41-ffa7c655de5a', 'volume_name': 'volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc4341c-eaeb-46f3-99cf-f740b236548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc4341c-eaeb-46f3-99cf-f740b236548a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8766d7fa-8877-472b-a981-a140a65d9ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Volume 7e39b1cf-3418-4ff7-8a41-ffa7c655de5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a', 'volume_size': 1} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1583372398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e39b1cf-3418-4ff7-8a41-ffa7c655de5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7844c8f03e7f44b59e1f89f3e3b4c53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:18Z,use_quota=True,user_id='d1df8a8be0954171ac5835cfc232fa71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Creating volume 7e39b1cf-3418-4ff7-8a41-ffa7c655de5a {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:25:18 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:18 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a 1073741824 Jul 03 16:25:18 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:19 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:25:19 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:19 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a 1073741824" returned: 0 in 1.635s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:20 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a Jul 03 16:25:20 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:20 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.177s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:25:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:25:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:25:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:25:20 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a" returned: 0 in 0.992s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] <== create_volume: return (2728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.731s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8766d7fa-8877-472b-a981-a140a65d9ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac04424a-c95b-4d90-b0ee-12678e940d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:21 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Volume volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a (7e39b1cf-3418-4ff7-8a41-ffa7c655de5a): created successfully Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac04424a-c95b-4d90-b0ee-12678e940d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Flow 'volume_create_manager' (d0fb5799-446c-4273-848c-4b8d84ed3386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-18bb7207-b513-4e03-9c0a-2c71508b7924 tempest-VolumesTestJSON-1246871758 None] Created volume successfully. Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Flow 'volume_create_manager' (9bda740d-d2bf-41cb-b9c2-0092ee84edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b349c3-5d68-4fca-a3a3-e3d8a90465b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b349c3-5d68-4fca-a3a3-e3d8a90465b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-668001731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736f192e-71c1-4ef6-b69b-5cda6fb2ab4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be29752f6c45e09c9aa90b6c85ac9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:21Z,use_quota=True,user_id='b4f26c70d3344ca68b6aa13d482fdcca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6a80a7-4891-425d-96a5-ebb7c89b7de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6a80a7-4891-425d-96a5-ebb7c89b7de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c039ae47-752b-435c-a9d6-6ed77ea41ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c039ae47-752b-435c-a9d6-6ed77ea41ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736f192e-71c1-4ef6-b69b-5cda6fb2ab4d', 'volume_name': 'volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd42a64-3b22-466a-bebc-ec78459ec560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd42a64-3b22-466a-bebc-ec78459ec560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4392def1-11b6-4a67-8fa1-29b11b4f4828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:21 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Volume 736f192e-71c1-4ef6-b69b-5cda6fb2ab4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d', 'volume_size': 1} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-668001731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736f192e-71c1-4ef6-b69b-5cda6fb2ab4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36be29752f6c45e09c9aa90b6c85ac9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:21Z,use_quota=True,user_id='b4f26c70d3344ca68b6aa13d482fdcca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Creating volume 736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:25:21 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:25:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:21 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d 1073741824 Jul 03 16:25:21 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Flow 'volume_create_manager' (f9f4b4ca-ed21-49b1-be6a-5e84df5d23dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb271aed-9002-40f4-97b2-cf497c9997f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb271aed-9002-40f4-97b2-cf497c9997f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-297156477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7844c8f03e7f44b59e1f89f3e3b4c53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:22Z,use_quota=True,user_id='d1df8a8be0954171ac5835cfc232fa71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d331aeb-6939-4922-8f3a-e8ffeaffad3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d331aeb-6939-4922-8f3a-e8ffeaffad3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ecd418-22d8-46f6-a6da-86e513520683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ecd418-22d8-46f6-a6da-86e513520683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f', 'volume_name': 'volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8311de31-13f4-4a54-bc87-d027048cd75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8311de31-13f4-4a54-bc87-d027048cd75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826ddc65-2415-4ce5-ae85-b94edcaae323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:22 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Volume df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f', 'volume_size': 1} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:22 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d 1073741824" returned: 0 in 1.206s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:22 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d Jul 03 16:25:22 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:23 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" returned: 0 in 0.832s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-297156477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7844c8f03e7f44b59e1f89f3e3b4c53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:22Z,use_quota=True,user_id='d1df8a8be0954171ac5835cfc232fa71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Creating volume df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:25:23 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:23 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f 1073741824 Jul 03 16:25:23 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4392def1-11b6-4a67-8fa1-29b11b4f4828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84508197-a587-457f-a846-24adc961bc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:23 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Volume volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d (736f192e-71c1-4ef6-b69b-5cda6fb2ab4d): created successfully Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84508197-a587-457f-a846-24adc961bc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Flow 'volume_create_manager' (9bda740d-d2bf-41cb-b9c2-0092ee84edc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:23 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a389b94f-1807-462f-9a1f-37875786cd4f tempest-VolumesSnapshotListTestJSON-195219259 None] Created volume successfully. Jul 03 16:25:24 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f 1073741824" returned: 0 in 1.025s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:24 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f Jul 03 16:25:24 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:25 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f" returned: 0 in 0.774s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.636s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826ddc65-2415-4ce5-ae85-b94edcaae323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1828934f-1d9c-4b12-9b66-3c254079a41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Creating offline snapshot 7bc15161-7b8b-482a-91eb-f4e98a28bab4 of volume 736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:25:25 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Volume volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f (df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f): created successfully Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1828934f-1d9c-4b12-9b66-3c254079a41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Flow 'volume_create_manager' (f9f4b4ca-ed21-49b1-be6a-5e84df5d23dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f08be2f-c38d-4433-8ddc-3c76690cd594]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-dae44796-39d5-44bc-a847-440099a60a6a tempest-VolumesTestJSON-1246871758 None] Created volume successfully. Jul 03 16:25:25 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d Jul 03 16:25:25 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:26 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" returned: 0 in 1.073s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:26 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 1G Jul 03 16:25:26 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:27 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 1G" returned: 0 in 1.256s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:27 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 Jul 03 16:25:27 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "cinder-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "cinder-quobyte-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-quobyte-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f10e7e-2405-42f7-a2cd-59f92f518c86]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:28 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f Jul 03 16:25:28 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:28 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4" returned: 0 in 0.994s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:28 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 is being set with open permissions: ugo+rw Jul 03 16:25:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:28 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 Jul 03 16:25:28 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:29 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f" returned: 0 in 1.105s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f" returned: 0 in 1.105s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:29 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f Jul 03 16:25:29 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:29 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4" returned: 0 in 0.968s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:29 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.info Jul 03 16:25:29 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:30 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f" returned: 0 in 1.066s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-quobyte-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f" released by "delete_volume" :: held 2.238s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Created reservations ['c7f5c52f-e0a9-43fd-aa97-14f6bf8cbbb0', 'f8c350f3-3458-475a-8068-894a0380b568', '109ab225-7a40-42c0-9d5e-8e993ae4ed1d', '93f396c3-142f-42fc-9bc7-f007e68ff0db'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:30 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.info" returned: 0 in 1.049s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:30 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.info is being set with open permissions: ugo+rw Jul 03 16:25:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:30 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:25:30 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:30 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.info Jul 03 16:25:30 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:31 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.844s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:25:31 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Deleted volume successfully. Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aa292109-a0e0-40ba-9f82-7a5d34bc7d32 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-df76d9ee-7114-4b5d-a0d8-9fcf73bbef1f-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "cinder-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "cinder-quobyte-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-quobyte-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a" acquired by "delete_volume" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:31 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.info" returned: 0 in 1.073s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.599s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc984c7-7b9d-457a-8976-0327d8d9af4c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fbc798b9-2e2c-4686-b19d-26e1de9bf5f3 tempest-VolumesSnapshotListTestJSON-195219259 None] Create snapshot completed successfully Jul 03 16:25:32 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a Jul 03 16:25:32 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Creating offline snapshot 62cdec6e-d96b-4372-8665-faff2b7cb2b8 of volume 736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:25:32 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[364632f2-ff19-4119-ad3c-98bf8ca399a3]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:32 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 Jul 03 16:25:32 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:32 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a" returned: 0 in 0.975s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:32 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a Jul 03 16:25:32 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:33 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4" returned: 0 in 0.902s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:33 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 1G Jul 03 16:25:33 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:33 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a" returned: 0 in 0.839s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-quobyte-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a" released by "delete_volume" :: held 1.896s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Created reservations ['21fe51ee-8d29-4754-965f-0928c414d5b9', '57ef22cc-89db-4d1c-9f13-14461f2c18b7', '6f0d91fb-a896-4aaf-89b6-8d019cc64ba2', '99144038-b3f8-494e-b6e7-03de46ce8c05'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:34 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:25:34 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "cinder-b5aaa029-7a96-467d-b0b3-d110144e19c3-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-b5aaa029-7a96-467d-b0b3-d110144e19c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "cinder-quobyte-b5aaa029-7a96-467d-b0b3-d110144e19c3" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-quobyte-b5aaa029-7a96-467d-b0b3-d110144e19c3" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b00cf2-bb1d-4b25-b478-fdf570f056fa]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:34 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 Jul 03 16:25:34 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:34 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 1G" returned: 0 in 1.323s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:34 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 Jul 03 16:25:34 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:34 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.012s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:34 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:25:35 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Deleted volume successfully. Jul 03 16:25:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f862ea50-210a-4f3a-9a94-ccdc26813607 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-7e39b1cf-3418-4ff7-8a41-ffa7c655de5a-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:35 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3" returned: 0 in 1.191s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:35 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3 Jul 03 16:25:35 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:35 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8" returned: 0 in 1.063s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:35 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 is being set with open permissions: ugo+rw Jul 03 16:25:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:35 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 Jul 03 16:25:35 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:36 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b5aaa029-7a96-467d-b0b3-d110144e19c3" returned: 0 in 0.817s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-quobyte-b5aaa029-7a96-467d-b0b3-d110144e19c3" released by "delete_volume" :: held 2.083s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Created reservations ['1a4d01fc-b29e-4235-ad14-1c0f9f00aae7', '28a5ab72-e385-4897-86bf-79cbae8bd080', 'd831f327-9374-4e31-a181-82e56bbf221b', '6c382cd8-3489-47ac-bccc-1ea4df655a2c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Flow 'volume_create_manager' (7e3aa86e-8924-4ff5-b785-165f92cc0da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf30dea9-ec47-4e48-b1aa-74c9ed1f5d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf30dea9-ec47-4e48-b1aa-74c9ed1f5d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1764421708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f68d4c8-09dc-47bc-969f-7a499f744413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0467a4e9804b3ea5272dc75c419dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:37Z,use_quota=True,user_id='dc5f31b227ef4eb4a166969c960ceeba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb44c56c-1eec-4921-8f87-3d8296c88972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb44c56c-1eec-4921-8f87-3d8296c88972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1d7b62-0234-43b3-9ede-2c2f101f48ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1d7b62-0234-43b3-9ede-2c2f101f48ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f68d4c8-09dc-47bc-969f-7a499f744413', 'volume_name': 'volume-7f68d4c8-09dc-47bc-969f-7a499f744413', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67255aa5-d78f-46b2-8ec2-4e515ef09bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67255aa5-d78f-46b2-8ec2-4e515ef09bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2505852d-198f-4fa4-a2c5-e077f116d395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:36 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Volume 7f68d4c8-09dc-47bc-969f-7a499f744413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f68d4c8-09dc-47bc-969f-7a499f744413', 'volume_size': 1} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:36 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8" returned: 0 in 0.895s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:36 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:25:36 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.344s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1764421708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f68d4c8-09dc-47bc-969f-7a499f744413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0467a4e9804b3ea5272dc75c419dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:37Z,use_quota=True,user_id='dc5f31b227ef4eb4a166969c960ceeba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Creating volume 7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:25:36 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:25:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:36 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 1073741824 Jul 03 16:25:36 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:36 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-32392c06-ae44-4acd-8d49-4b4850168f75 tempest-VolumesSnapshotListTestJSON-195219259 None] Create snapshot completed successfully Jul 03 16:25:37 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.841s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:37 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:25:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Deleted volume successfully. Jul 03 16:25:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a42f6d05-9d2b-49dd-895f-17ab7b6b7a23 tempest-VolumesTestJSON-1246871758 None] Lock "cinder-b5aaa029-7a96-467d-b0b3-d110144e19c3-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:37 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 1073741824" returned: 0 in 1.064s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:37 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 Jul 03 16:25:37 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-cab17eb2-cd88-4d4a-9a94-c41fcef3ab80 req-44de0708-268a-4564-969f-495828450139 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:38 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413" returned: 0 in 0.840s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.715s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Creating offline snapshot c33382ea-0cc6-4287-a34a-3e1f179deea3 of volume 736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2505852d-198f-4fa4-a2c5-e077f116d395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f68d4c8-09dc-47bc-969f-7a499f744413', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68b4213-3219-41b6-8e04-97a6b381c0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d93f1-317f-493d-921e-32b3b84c1b52]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Volume volume-7f68d4c8-09dc-47bc-969f-7a499f744413 (7f68d4c8-09dc-47bc-969f-7a499f744413): created successfully Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68b4213-3219-41b6-8e04-97a6b381c0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Flow 'volume_create_manager' (7e3aa86e-8924-4ff5-b785-165f92cc0da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-388913f7-67da-4e20-89be-a783e589ab0a tempest-VolumesCloneTest-1966181242 None] Created volume successfully. Jul 03 16:25:38 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 Jul 03 16:25:38 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:39 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8" returned: 0 in 0.922s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:25:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:39 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 1G Jul 03 16:25:39 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Flow 'volume_create_manager' (0d74b94a-9508-4424-bb39-bdf414aa3809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8f3d09-47fc-4d8e-8d7e-7291c2e4c107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8f3d09-47fc-4d8e-8d7e-7291c2e4c107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1751060097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490b025b-4f46-4b67-8d1f-667b6bedf24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0467a4e9804b3ea5272dc75c419dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:25:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7f68d4c8-09dc-47bc-969f-7a499f744413,status='creating',terminated_at=None,updated_at=2026-07-03T14:25:40Z,use_quota=True,user_id='dc5f31b227ef4eb4a166969c960ceeba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78acf557-6141-4be6-857c-53be3a95df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78acf557-6141-4be6-857c-53be3a95df1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2596c901-5172-4879-bddc-a68cc8b37947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2596c901-5172-4879-bddc-a68cc8b37947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '490b025b-4f46-4b67-8d1f-667b6bedf24f', 'volume_name': 'volume-490b025b-4f46-4b67-8d1f-667b6bedf24f', 'volume_size': 2, 'source_volid': '7f68d4c8-09dc-47bc-969f-7a499f744413', 'source_volstatus': 'available'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeaebca5-fe48-43ba-8e9d-a01938a06535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeaebca5-fe48-43ba-8e9d-a01938a06535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd98a90-57ea-441e-96fc-a528525e5d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:25:40 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Volume 490b025b-4f46-4b67-8d1f-667b6bedf24f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-490b025b-4f46-4b67-8d1f-667b6bedf24f', 'volume_size': 2, 'source_volid': '7f68d4c8-09dc-47bc-969f-7a499f744413', 'source_volstatus': 'available'} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:40 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 1G" returned: 0 in 1.058s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:40 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 Jul 03 16:25:40 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:41 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3" returned: 0 in 0.770s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:41 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 is being set with open permissions: ugo+rw Jul 03 16:25:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:41 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 Jul 03 16:25:41 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:42 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3" returned: 0 in 0.694s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.579s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-cab17eb2-cd88-4d4a-9a94-c41fcef3ab80 req-44de0708-268a-4564-969f-495828450139 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.729s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:42 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbcfcef-e163-488a-a557-c5c0bf3f3111]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-cab17eb2-cd88-4d4a-9a94-c41fcef3ab80 req-44de0708-268a-4564-969f-495828450139 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:42 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-89fe3d9c-2bf9-4537-b15b-acede42a9bd6 tempest-VolumesSnapshotListTestJSON-195219259 None] Create snapshot completed successfully Jul 03 16:25:42 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 Jul 03 16:25:42 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:43 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-cab17eb2-cd88-4d4a-9a94-c41fcef3ab80 req-44de0708-268a-4564-969f-495828450139 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6" returned: 0 in 0.893s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-cab17eb2-cd88-4d4a-9a94-c41fcef3ab80 req-44de0708-268a-4564-969f-495828450139 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.926s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.697s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:43 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Cloning volume 7f68d4c8-09dc-47bc-969f-7a499f744413 to volume 490b025b-4f46-4b67-8d1f-667b6bedf24f Jul 03 16:25:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-cab17eb2-cd88-4d4a-9a94-c41fcef3ab80 req-44de0708-268a-4564-969f-495828450139 tempest-TestInstancesWithCinderVolumes-1394990013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-e689455e-2810-4a8f-b551-c484668e85f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b19c26d-91b1-480f-83de-98787903fe4b', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:25:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Creating offline snapshot 34c22ed5-d177-44cb-80d5-797b327ef4a1 of volume 7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:25:43 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce78214-184c-4b67-ad30-c06872be61ae]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:43 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-cab17eb2-cd88-4d4a-9a94-c41fcef3ab80 req-44de0708-268a-4564-969f-495828450139 tempest-TestInstancesWithCinderVolumes-1394990013 None] attachment_update completed successfully. Jul 03 16:25:43 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 Jul 03 16:25:43 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-c33382ea-0cc6-4287-a34a-3e1f179deea3-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-c33382ea-0cc6-4287-a34a-3e1f179deea3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-quobyte-c33382ea-0cc6-4287-a34a-3e1f179deea3" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-c33382ea-0cc6-4287-a34a-3e1f179deea3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Deleting offline snapshot c33382ea-0cc6-4287-a34a-3e1f179deea3 of volume 736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] snapshot_file for this snap is: volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b472ca-590e-4462-a339-8ecf6cd0d324]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:44 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413" returned: 0 in 1.436s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:44 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 1G Jul 03 16:25:44 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:44 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 Jul 03 16:25:44 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:45 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3" returned: 0 in 0.985s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:25:45 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa5f0e-d45a-40e6-acbc-8dfcfa098760]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:45 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 1G" returned: 0 in 1.044s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f68d4c8-09dc-47bc-969f-7a499f744413 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:45 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f68d4c8-09dc-47bc-969f-7a499f744413 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 Jul 03 16:25:45 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:45 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 Jul 03 16:25:45 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:46 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f68d4c8-09dc-47bc-969f-7a499f744413 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1" returned: 0 in 0.837s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:46 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 is being set with open permissions: ugo+rw Jul 03 16:25:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:46 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 Jul 03 16:25:46 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:46 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8" returned: 0 in 1.012s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:25:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:46 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 Jul 03 16:25:46 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:47 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1" returned: 0 in 0.797s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:47 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.info Jul 03 16:25:47 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:47 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3" returned: 0 in 0.963s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:47 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3 Jul 03 16:25:47 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:48 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.info" returned: 0 in 0.824s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:48 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.info is being set with open permissions: ugo+rw Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:48 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.info Jul 03 16:25:48 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:48 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.c33382ea-0cc6-4287-a34a-3e1f179deea3" returned: 0 in 0.763s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-c33382ea-0cc6-4287-a34a-3e1f179deea3" released by "_delete_snapshot" :: held 3.888s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" released by "delete_snapshot" :: held 3.925s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fcf3203d-1af8-4d0a-a484-6c9cfe0df6d8 tempest-GroupsV320Test-330049915 None] Group tempest-GroupsV320Test-Group-922490861: creating Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Created reservations ['5257623c-6049-49ac-b204-0ae4dd8b6612', 'd4882ede-2787-42ae-aa3f-4ef5189c22a2', '3e883925-eb5c-4242-8566-36b1a3463380', 'e6ae159d-34c7-4849-9044-4a4cf878c2af'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:25:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fcf3203d-1af8-4d0a-a484-6c9cfe0df6d8 tempest-GroupsV320Test-330049915 None] Group tempest-GroupsV320Test-Group-922490861: created successfully Jul 03 16:25:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fcf3203d-1af8-4d0a-a484-6c9cfe0df6d8 tempest-GroupsV320Test-330049915 None] Create group completed successfully. Jul 03 16:25:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Delete snapshot completed successfully. Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-051bf587-16e1-4e12-afe4-7318b027714b tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-c33382ea-0cc6-4287-a34a-3e1f179deea3-delete_snapshot" released by "delete_snapshot" :: held 4.207s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-62cdec6e-d96b-4372-8665-faff2b7cb2b8-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-62cdec6e-d96b-4372-8665-faff2b7cb2b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-quobyte-62cdec6e-d96b-4372-8665-faff2b7cb2b8" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-62cdec6e-d96b-4372-8665-faff2b7cb2b8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Deleting offline snapshot 62cdec6e-d96b-4372-8665-faff2b7cb2b8 of volume 736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] snapshot_file for this snap is: volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68999a3-7006-4aee-8b59-05cfaf58ccd9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:49 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.info" returned: 0 in 0.812s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Acquiring lock "cinder-quobyte-490b025b-4f46-4b67-8d1f-667b6bedf24f" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Lock "cinder-quobyte-490b025b-4f46-4b67-8d1f-667b6bedf24f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] snapshot: 34c22ed5-d177-44cb-80d5-797b327ef4a1, volume: 490b025b-4f46-4b67-8d1f-667b6bedf24f, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:25:49 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 Jul 03 16:25:49 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec47be60-d0c9-4842-9b86-212ed3b1e844]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:49 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 Jul 03 16:25:49 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:49 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8" returned: 0 in 0.899s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7a1339-c4c3-4f7c-860d-e0887d6937ca]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:50 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1" returned: 0 in 0.853s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f68d4c8-09dc-47bc-969f-7a499f744413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1d30fa-ec90-4836-bc30-c9c9521ade2e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:50 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 Jul 03 16:25:50 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:50 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 Jul 03 16:25:50 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] Created reservations ['233affac-dc99-4d52-b356-56c7741ce31b'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:25:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:50 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:25:50 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:51 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:51 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413" returned: 0 in 0.928s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4" returned: 0 in 0.990s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:51 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:25:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:25:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:51 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f Jul 03 16:25:51 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:51 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 Jul 03 16:25:51 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:51 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.772s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:51 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:25:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-830d75da-77f6-4407-8b3b-348baed34e03 tempest-GroupsV320Test-330049915 None] Delete group completed successfully. Jul 03 16:25:52 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8" returned: 0 in 1.066s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:52 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8 Jul 03 16:25:52 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-e7e26988-b93c-4482-ad6e-0ab6724dc15c req-8bdae9dc-5485-4bef-a880-218b2f8ae332 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:25:54 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.62cdec6e-d96b-4372-8665-faff2b7cb2b8" returned: 0 in 2.217s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-62cdec6e-d96b-4372-8665-faff2b7cb2b8" released by "_delete_snapshot" :: held 5.435s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" released by "delete_snapshot" :: held 5.476s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:54 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Created reservations ['bb121be1-33d0-4c77-82bd-2ae651865ab3', '55bda77f-779e-4695-aa62-58a712881010', '356be1c8-4e86-4224-8632-dd339ccd75f3', '89fbe2c6-ce93-4a03-b840-fd4dbd9ff1bd'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:25:54 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Delete snapshot completed successfully. Jul 03 16:25:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-02218892-1f89-4071-8884-b1be78681c4c tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-62cdec6e-d96b-4372-8665-faff2b7cb2b8-delete_snapshot" released by "delete_snapshot" :: held 5.821s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-7bc15161-7b8b-482a-91eb-f4e98a28bab4-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-7bc15161-7b8b-482a-91eb-f4e98a28bab4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-quobyte-7bc15161-7b8b-482a-91eb-f4e98a28bab4" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-7bc15161-7b8b-482a-91eb-f4e98a28bab4" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Deleting offline snapshot 7bc15161-7b8b-482a-91eb-f4e98a28bab4 of volume 736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:25:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] snapshot_file for this snap is: volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:25:56 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0172f822-f627-473b-8040-c4ce13901f7b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:56 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 Jul 03 16:25:56 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:57 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f" returned: 0 in 6.637s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7381f4bb-9baa-425e-9a39-2623f2df8c38]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:57 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 Jul 03 16:25:57 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:57 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4" returned: 0 in 1.747s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:25:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e8bae3-5d3b-4b77-9718-decf7472da96]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:58 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d Jul 03 16:25:58 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:58 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:58 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" returned: 0 in 0.888s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413" returned: 0 in 1.148s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:58 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:25:58 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Converted 1024.00 MB image at 154.24 MB/s Jul 03 16:25:58 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f is being set with open permissions: ugo+rw Jul 03 16:25:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:58 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 Jul 03 16:25:58 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:58 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f Jul 03 16:25:58 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:59 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f" returned: 0 in 0.761s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Lock "cinder-quobyte-490b025b-4f46-4b67-8d1f-667b6bedf24f" released by "_copy_volume_from_snapshot" :: held 10.453s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=76,cinder:UPDATE=88,cinder:DELETE=10,cinder:INSERT=16 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Acquiring lock "cinder-quobyte-34c22ed5-d177-44cb-80d5-797b327ef4a1" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Lock "cinder-quobyte-34c22ed5-d177-44cb-80d5-797b327ef4a1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Deleting offline snapshot 34c22ed5-d177-44cb-80d5-797b327ef4a1 of volume 7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] snapshot_file for this snap is: volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:25:59 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4" returned: 0 in 0.886s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82f0ebb-1069-4b94-b00b-3892e72f51e7]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:25:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:25:59 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4 Jul 03 16:25:59 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:25:59 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 Jul 03 16:25:59 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:00 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d.7bc15161-7b8b-482a-91eb-f4e98a28bab4" returned: 0 in 0.699s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=89,cinder:SELECT=78,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-7bc15161-7b8b-482a-91eb-f4e98a28bab4" released by "_delete_snapshot" :: held 4.489s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" released by "delete_snapshot" :: held 4.558s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Created reservations ['7480b28e-cf63-4fe1-8483-0cdb98e0e335', 'b7c2c614-1b31-4a63-a3d1-6c7c1199cde5', '1ada92c4-32f8-4537-a2c9-8581f27f4b61', '2647af89-9a41-4516-976b-5f43bf63f30b'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:00 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Delete snapshot completed successfully. Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a8c3d5a-3c49-45db-8f72-ef972869ef2e tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-7bc15161-7b8b-482a-91eb-f4e98a28bab4-delete_snapshot" released by "delete_snapshot" :: held 4.771s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:00 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1" returned: 0 in 0.931s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f68d4c8-09dc-47bc-969f-7a499f744413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ec6dd3-3806-4090-bb4a-56f2b0e000ec]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:00 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 Jul 03 16:26:00 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[873cfd7b-7d5c-4969-bdef-bc59f25fcbb0]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:01 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413" returned: 0 in 0.976s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:01 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 Jul 03 16:26:01 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:01 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d Jul 03 16:26:01 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:02 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" returned: 0 in 0.979s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:02 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d Jul 03 16:26:02 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:02 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1" returned: 0 in 1.062s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:02 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1 Jul 03 16:26:02 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:03 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" returned: 0 in 0.811s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-quobyte-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d" released by "delete_volume" :: held 1.876s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Created reservations ['661b015d-8240-419f-a674-1c7551aad40a', 'd0b4e8d2-0249-47eb-985b-b9bcc8db7e2c', 'e6b1598f-f4de-4205-8b28-be3949ef51b7', 'a34be0ef-5754-4548-8d4d-d61b48a3712d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:03 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:03 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:03 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413.34c22ed5-d177-44cb-80d5-797b327ef4a1" returned: 0 in 0.894s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Lock "cinder-quobyte-34c22ed5-d177-44cb-80d5-797b327ef4a1" released by "_delete_snapshot" :: held 4.002s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.498s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-e7e26988-b93c-4482-ad6e-0ab6724dc15c req-8bdae9dc-5485-4bef-a880-218b2f8ae332 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.410s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd98a90-57ea-441e-96fc-a528525e5d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-490b025b-4f46-4b67-8d1f-667b6bedf24f', 'volume_size': 2, 'source_volid': '7f68d4c8-09dc-47bc-969f-7a499f744413', 'source_volstatus': 'available'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b2e44d-4a4b-438a-86fc-9b383b1ea6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fddb2ec-5db8-4635-b62d-19e1cb16b6f4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-e7e26988-b93c-4482-ad6e-0ab6724dc15c req-8bdae9dc-5485-4bef-a880-218b2f8ae332 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:03 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Volume volume-490b025b-4f46-4b67-8d1f-667b6bedf24f (490b025b-4f46-4b67-8d1f-667b6bedf24f): created successfully Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b2e44d-4a4b-438a-86fc-9b383b1ea6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Flow 'volume_create_manager' (0d74b94a-9508-4424-bb39-bdf414aa3809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9a337676-38ad-4b90-ba2c-b42599f2fa22 tempest-VolumesCloneTest-1966181242 None] Created volume successfully. Jul 03 16:26:04 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 Jul 03 16:26:04 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:04 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.070s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:04 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:04 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Deleted volume successfully. Jul 03 16:26:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5d2ee01-9ea5-4c88-96ae-2948f151b8e1 tempest-VolumesSnapshotListTestJSON-195219259 None] Lock "cinder-736f192e-71c1-4ef6-b69b-5cda6fb2ab4d-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:05 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-e7e26988-b93c-4482-ad6e-0ab6724dc15c req-8bdae9dc-5485-4bef-a880-218b2f8ae332 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5" returned: 0 in 1.185s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-e7e26988-b93c-4482-ad6e-0ab6724dc15c req-8bdae9dc-5485-4bef-a880-218b2f8ae332 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.280s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-e7e26988-b93c-4482-ad6e-0ab6724dc15c req-8bdae9dc-5485-4bef-a880-218b2f8ae332 tempest-TestInstancesWithCinderVolumes-1394990013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-96e73a73-3c91-4522-aeda-7d515578d4d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f32ebd0f-2b57-4a6f-b487-4b86a5e839f6', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:26:05 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-e7e26988-b93c-4482-ad6e-0ab6724dc15c req-8bdae9dc-5485-4bef-a880-218b2f8ae332 tempest-TestInstancesWithCinderVolumes-1394990013 None] attachment_update completed successfully. Jul 03 16:26:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Acquiring lock "cinder-490b025b-4f46-4b67-8d1f-667b6bedf24f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Lock "cinder-490b025b-4f46-4b67-8d1f-667b6bedf24f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Acquiring lock "cinder-quobyte-490b025b-4f46-4b67-8d1f-667b6bedf24f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Lock "cinder-quobyte-490b025b-4f46-4b67-8d1f-667b6bedf24f" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:05 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fff677-a3d2-44c9-b780-458a6f026745]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:05 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f Jul 03 16:26:05 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:06 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f" returned: 0 in 1.014s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:06 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f Jul 03 16:26:06 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-490b025b-4f46-4b67-8d1f-667b6bedf24f" returned: 0 in 0.759s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:07 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Lock "cinder-quobyte-490b025b-4f46-4b67-8d1f-667b6bedf24f" released by "delete_volume" :: held 1.836s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Created reservations ['89cc4cd7-51dd-4567-848f-5c1f5e571f07', '0d66e296-07d3-4869-b5d4-1d68623050ce', 'c3e9f80e-4c90-4024-8074-9feb87ba881c', '4600b08d-31dd-44ac-b246-acffbd15e800'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:07 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:07 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Acquiring lock "cinder-7f68d4c8-09dc-47bc-969f-7a499f744413-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Lock "cinder-7f68d4c8-09dc-47bc-969f-7a499f744413-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Acquiring lock "cinder-quobyte-7f68d4c8-09dc-47bc-969f-7a499f744413" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Lock "cinder-quobyte-7f68d4c8-09dc-47bc-969f-7a499f744413" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:08 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6c8c0c-6b7e-40d5-8029-766e86f672e9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:08 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 Jul 03 16:26:08 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:08 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.896s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:08 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:08 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Deleted volume successfully. Jul 03 16:26:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ce272443-ba19-483b-86f7-aab142d0b05c tempest-VolumesCloneTest-1966181242 None] Lock "cinder-490b025b-4f46-4b67-8d1f-667b6bedf24f-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:09 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413" returned: 0 in 1.038s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:09 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413 Jul 03 16:26:09 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:09 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7f68d4c8-09dc-47bc-969f-7a499f744413" returned: 0 in 0.885s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Lock "cinder-quobyte-7f68d4c8-09dc-47bc-969f-7a499f744413" released by "delete_volume" :: held 2.025s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:10 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Created reservations ['407a6558-0670-42f0-a406-2b3bc52f888c', '4042d2da-c81a-46ad-b63f-cee05140883f', '723c4098-832c-479a-ac03-fd60f7dd8515', 'e71ee08e-ab88-4651-9a6f-0b0858b53a09'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:10 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:10 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:11 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.902s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:11 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Deleted volume successfully. Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-952075e7-dad5-4ad1-82f0-565929e008e7 tempest-VolumesCloneTest-1966181242 None] Lock "cinder-7f68d4c8-09dc-47bc-969f-7a499f744413-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Flow 'volume_create_manager' (64193206-ed40-4ad9-ba1b-5464b4821c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6e6e14-c4b5-4835-b764-90f8b77a1411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6e6e14-c4b5-4835-b764-90f8b77a1411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1002190108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20390155-8e24-43d0-a74e-951b76923ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caff3c1483ee487c96f7901e0c7e1957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:12Z,use_quota=True,user_id='4434395128284f11bc2b0c519866592f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c100f1-07ce-48da-a663-67b3f084945a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c100f1-07ce-48da-a663-67b3f084945a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c83bcd-0cde-4c2d-bc54-3eac59a73f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c83bcd-0cde-4c2d-bc54-3eac59a73f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20390155-8e24-43d0-a74e-951b76923ed1', 'volume_name': 'volume-20390155-8e24-43d0-a74e-951b76923ed1', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1a6383-df14-4369-ad32-15a8e887f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1a6383-df14-4369-ad32-15a8e887f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8420ec92-cfab-4b34-b229-555c6a617017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:11 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Volume 20390155-8e24-43d0-a74e-951b76923ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20390155-8e24-43d0-a74e-951b76923ed1', 'volume_size': 1} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1002190108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20390155-8e24-43d0-a74e-951b76923ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caff3c1483ee487c96f7901e0c7e1957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:12Z,use_quota=True,user_id='4434395128284f11bc2b0c519866592f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Creating volume 20390155-8e24-43d0-a74e-951b76923ed1 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:26:11 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:26:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:11 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1 1073741824 Jul 03 16:26:11 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:13 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1 1073741824" returned: 0 in 1.171s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:13 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1 Jul 03 16:26:13 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:14 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1" returned: 0 in 1.272s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] <== create_volume: return (2535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:26:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.539s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8420ec92-cfab-4b34-b229-555c6a617017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20390155-8e24-43d0-a74e-951b76923ed1', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7aac1a-dce4-45b8-a6be-ca85b74a04f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:14 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Volume volume-20390155-8e24-43d0-a74e-951b76923ed1 (20390155-8e24-43d0-a74e-951b76923ed1): created successfully Jul 03 16:26:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7aac1a-dce4-45b8-a6be-ca85b74a04f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Flow 'volume_create_manager' (64193206-ed40-4ad9-ba1b-5464b4821c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-20be0321-95ba-4759-b53d-5f68b2782e8c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Created volume successfully. Jul 03 16:26:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Acquiring lock "cinder-20390155-8e24-43d0-a74e-951b76923ed1-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "cinder-20390155-8e24-43d0-a74e-951b76923ed1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Acquiring lock "cinder-quobyte-20390155-8e24-43d0-a74e-951b76923ed1" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "cinder-quobyte-20390155-8e24-43d0-a74e-951b76923ed1" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:15 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a0409-3cba-4aa0-b2ed-b05fb7630112]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:15 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1 Jul 03 16:26:15 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Flow 'volume_create_manager' (d94f850e-7a5b-4d95-87d4-a92ea75554f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e198db9-a29c-4f8a-b3cc-17c71852566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e198db9-a29c-4f8a-b3cc-17c71852566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-937925405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4bf953-c613-4edd-9dcd-e743b7ec0c8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caa4bbb05ff845118e52fa68aa8dfe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:16Z,use_quota=True,user_id='8885c0d810cc499ab1cf462f6cdefe58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9110a5-cebd-42a5-b40a-29cf825f2753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9110a5-cebd-42a5-b40a-29cf825f2753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71cf9fa-ed70-4c43-90ed-4351502a01b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71cf9fa-ed70-4c43-90ed-4351502a01b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4bf953-c613-4edd-9dcd-e743b7ec0c8d', 'volume_name': 'volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7909e4-44c5-4ba0-9cd3-4e90a7e30cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7909e4-44c5-4ba0-9cd3-4e90a7e30cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88f3976-abad-4c21-9e00-f02a4afda859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:16 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Volume ea4bf953-c613-4edd-9dcd-e743b7ec0c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d', 'volume_size': 1} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-937925405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4bf953-c613-4edd-9dcd-e743b7ec0c8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caa4bbb05ff845118e52fa68aa8dfe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:16Z,use_quota=True,user_id='8885c0d810cc499ab1cf462f6cdefe58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Creating volume ea4bf953-c613-4edd-9dcd-e743b7ec0c8d {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:26:16 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:16 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-7913a5b9-91d9-4eb8-8461-0ac84b9737a3 req-f97b6f89-68be-45e0-bc69-b8bc18a85338 tempest-TestInstancesWithCinderVolumes-1394990013 None] Terminate volume connection completed successfully. Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-7913a5b9-91d9-4eb8-8461-0ac84b9737a3 req-f97b6f89-68be-45e0-bc69-b8bc18a85338 tempest-TestInstancesWithCinderVolumes-1394990013 None] Deleting attachment 0b19c26d-91b1-480f-83de-98787903fe4b. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:26:16 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d 1073741824 Jul 03 16:26:16 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:16 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1" returned: 0 in 1.502s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:16 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1 Jul 03 16:26:16 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:17 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d 1073741824" returned: 0 in 1.368s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:17 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d Jul 03 16:26:17 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:18 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-20390155-8e24-43d0-a74e-951b76923ed1" returned: 0 in 1.180s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "cinder-quobyte-20390155-8e24-43d0-a74e-951b76923ed1" released by "delete_volume" :: held 2.759s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Created reservations ['ed5a29d6-ce76-4aad-8d7f-112f000ea96b', '5b430f72-b785-4450-a468-35ec031a58b3', '71321d8f-f347-4e4b-baed-56afc09073ed', 'a8d1a888-d45f-48fd-90a3-1accd839db87'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:18 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:18 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "cinder-e689455e-2810-4a8f-b551-c484668e85f6-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-e689455e-2810-4a8f-b551-c484668e85f6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "cinder-quobyte-e689455e-2810-4a8f-b551-c484668e85f6" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-quobyte-e689455e-2810-4a8f-b551-c484668e85f6" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb095d13-4508-4837-b4ce-693612e409bd]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:18 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 Jul 03 16:26:18 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:19 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:19 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:19 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d" returned: 0 in 1.219s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] <== create_volume: return (2648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.652s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a88f3976-abad-4c21-9e00-f02a4afda859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a54bbbd-e214-42b9-a0d2-933e48163471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:19 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Volume volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d (ea4bf953-c613-4edd-9dcd-e743b7ec0c8d): created successfully Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a54bbbd-e214-42b9-a0d2-933e48163471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Flow 'volume_create_manager' (d94f850e-7a5b-4d95-87d4-a92ea75554f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:19 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-bd9a33e7-c123-42ae-8edc-52ad4e3292a8 tempest-VolumesListTestJSON-141396004 None] Created volume successfully. Jul 03 16:26:19 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.288s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:19 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Deleted volume successfully. Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5b230e5-7043-489f-b513-400644b8e039 tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "cinder-20390155-8e24-43d0-a74e-951b76923ed1-delete_volume" released by "delete_volume" :: held 4.467s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:26:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Flow 'volume_create_manager' (2d40e748-c4a2-4c29-9461-56e0d78817fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602acd42-acc3-4982-94eb-62a4ca919889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602acd42-acc3-4982-94eb-62a4ca919889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1688351976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1cb6ce-9aad-404b-a17a-4d6b768927b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caff3c1483ee487c96f7901e0c7e1957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:20Z,use_quota=True,user_id='4434395128284f11bc2b0c519866592f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9825b600-cdff-4a5e-bfef-d87402aca2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9825b600-cdff-4a5e-bfef-d87402aca2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c4d0d8-c23b-4c79-b5dd-e6372d060c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c4d0d8-c23b-4c79-b5dd-e6372d060c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da1cb6ce-9aad-404b-a17a-4d6b768927b6', 'volume_name': 'volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa50ddb-c14f-4cd8-8e57-820b9521e6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa50ddb-c14f-4cd8-8e57-820b9521e6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6307b6-5b79-46e5-a38e-4ebc3620a7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:20 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Volume da1cb6ce-9aad-404b-a17a-4d6b768927b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6', 'volume_size': 1} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1688351976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1cb6ce-9aad-404b-a17a-4d6b768927b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caff3c1483ee487c96f7901e0c7e1957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:20Z,use_quota=True,user_id='4434395128284f11bc2b0c519866592f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Creating volume da1cb6ce-9aad-404b-a17a-4d6b768927b6 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:26:20 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:20 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 1073741824 Jul 03 16:26:20 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:20 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6" returned: 0 in 1.673s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:20 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6 Jul 03 16:26:20 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:20 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.367s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:26:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:26:21 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e689455e-2810-4a8f-b551-c484668e85f6" returned: 0 in 1.347s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-quobyte-e689455e-2810-4a8f-b551-c484668e85f6" released by "delete_volume" :: held 3.095s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:21 devstack cinder-volume[86659]: WARNING cinder.quota [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1801789857-860607004 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1801789857-860607004, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:26:21 devstack cinder-volume[86659]: WARNING cinder.quota [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1801789857-860607004 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1801789857-860607004, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:26:21 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Created reservations ['d8084355-db65-46e5-8e30-f11bb54fe423', '83cd3f32-1501-4a71-b55d-c734ef181b4b', 'd5cd3c4e-a1ca-402c-b760-0273b81dce8f', '8925309c-e82b-4877-b700-4838c3c708cd'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:21 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:26:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Flow 'volume_create_manager' (8a2c39dd-cad9-41ee-b580-0a4730b4a191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0834320-9deb-4e3c-b45d-6c3231bf0e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0834320-9deb-4e3c-b45d-6c3231bf0e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1360058212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01038f5a-8003-4360-adc9-f1a4ed616be2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caa4bbb05ff845118e52fa68aa8dfe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:22Z,use_quota=True,user_id='8885c0d810cc499ab1cf462f6cdefe58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2094694d-ac4a-42ee-b665-159fba039a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2094694d-ac4a-42ee-b665-159fba039a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec622ab-6896-46c4-b8be-963854428a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec622ab-6896-46c4-b8be-963854428a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01038f5a-8003-4360-adc9-f1a4ed616be2', 'volume_name': 'volume-01038f5a-8003-4360-adc9-f1a4ed616be2', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d36ed2-7928-4b0c-8b40-cb5577d9dc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d36ed2-7928-4b0c-8b40-cb5577d9dc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d277c5-3602-43a6-87c3-c057548a4c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:22 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Volume 01038f5a-8003-4360-adc9-f1a4ed616be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01038f5a-8003-4360-adc9-f1a4ed616be2', 'volume_size': 1} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:22 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 1073741824" returned: 0 in 2.022s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:22 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:22 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:22 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 Jul 03 16:26:22 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:22 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.822s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:22 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Deleted volume successfully. Jul 03 16:26:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-01a2ffd6-1d04-407b-b72c-9b3627a44dfa tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-e689455e-2810-4a8f-b551-c484668e85f6-delete_volume" released by "delete_volume" :: held 4.550s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:23 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6" returned: 0 in 0.937s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] <== create_volume: return (3036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.041s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1360058212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01038f5a-8003-4360-adc9-f1a4ed616be2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caa4bbb05ff845118e52fa68aa8dfe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:22Z,use_quota=True,user_id='8885c0d810cc499ab1cf462f6cdefe58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Creating volume 01038f5a-8003-4360-adc9-f1a4ed616be2 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:26:23 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6307b6-5b79-46e5-a38e-4ebc3620a7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:23 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2 1073741824 Jul 03 16:26:23 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc63b25a-6e82-4046-9eec-d1fc0c5e1b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:23 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Volume volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 (da1cb6ce-9aad-404b-a17a-4d6b768927b6): created successfully Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc63b25a-6e82-4046-9eec-d1fc0c5e1b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Flow 'volume_create_manager' (2d40e748-c4a2-4c29-9461-56e0d78817fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:23 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f4f7f696-a378-4751-8f19-c35da755773c tempest-VolumeQuotasAdminTestJSON-1445008135 None] Created volume successfully. Jul 03 16:26:24 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2 1073741824" returned: 0 in 1.263s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:24 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2 Jul 03 16:26:24 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:24 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-930a430b-da9b-4bff-9e2b-0e9068718c01 req-f8309afd-e417-441d-aa58-723548524b33 tempest-TestInstancesWithCinderVolumes-1394990013 None] Terminate volume connection completed successfully. Jul 03 16:26:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-930a430b-da9b-4bff-9e2b-0e9068718c01 req-f8309afd-e417-441d-aa58-723548524b33 tempest-TestInstancesWithCinderVolumes-1394990013 None] Deleting attachment f32ebd0f-2b57-4a6f-b487-4b86a5e839f6. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:26:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0f43f478-d350-407b-a7e6-c4dfd6d29552 tempest-VolumeQuotasAdminTestJSON-1147721185 None] Transfer volume completed successfully. Jul 03 16:26:25 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2" returned: 0 in 0.993s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:26:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.327s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d277c5-3602-43a6-87c3-c057548a4c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01038f5a-8003-4360-adc9-f1a4ed616be2', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a229f94-5be1-4dbd-9a49-345cc9d4d7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:25 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Volume volume-01038f5a-8003-4360-adc9-f1a4ed616be2 (01038f5a-8003-4360-adc9-f1a4ed616be2): created successfully Jul 03 16:26:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a229f94-5be1-4dbd-9a49-345cc9d4d7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Flow 'volume_create_manager' (8a2c39dd-cad9-41ee-b580-0a4730b4a191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-81089fc2-e7bb-4e91-9fbd-9f98b819dfd4 tempest-VolumesListTestJSON-141396004 None] Created volume successfully. Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Acquiring lock "cinder-da1cb6ce-9aad-404b-a17a-4d6b768927b6-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Lock "cinder-da1cb6ce-9aad-404b-a17a-4d6b768927b6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Acquiring lock "cinder-quobyte-da1cb6ce-9aad-404b-a17a-4d6b768927b6" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Lock "cinder-quobyte-da1cb6ce-9aad-404b-a17a-4d6b768927b6" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b0805-77f0-4a26-af0d-2dfa442b2813]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Flow 'volume_create_manager' (62a65952-25f5-4ce6-891c-c47ed9c40a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6132b36f-c680-4a98-ba60-1897f7fd8e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:26 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 Jul 03 16:26:26 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6132b36f-c680-4a98-ba60-1897f7fd8e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-683117963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b13a085-9495-46a1-9b91-45f8cbb57d9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caa4bbb05ff845118e52fa68aa8dfe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:27Z,use_quota=True,user_id='8885c0d810cc499ab1cf462f6cdefe58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdd72d3-9d0e-46c8-9615-29cfdccd99b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdd72d3-9d0e-46c8-9615-29cfdccd99b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66872912-a821-4f36-9561-a85a2ab1e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66872912-a821-4f36-9561-a85a2ab1e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b13a085-9495-46a1-9b91-45f8cbb57d9f', 'volume_name': 'volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae7a607-3a52-49fb-81b8-2c5d29b947f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae7a607-3a52-49fb-81b8-2c5d29b947f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab0d9ae-d664-421e-bb11-d3a9f3f62095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Volume 6b13a085-9495-46a1-9b91-45f8cbb57d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f', 'volume_size': 1} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-683117963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b13a085-9495-46a1-9b91-45f8cbb57d9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caa4bbb05ff845118e52fa68aa8dfe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:27Z,use_quota=True,user_id='8885c0d810cc499ab1cf462f6cdefe58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Creating volume 6b13a085-9495-46a1-9b91-45f8cbb57d9f {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:26:26 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "cinder-96e73a73-3c91-4522-aeda-7d515578d4d5-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:26 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f 1073741824 Jul 03 16:26:26 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-96e73a73-3c91-4522-aeda-7d515578d4d5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "cinder-quobyte-96e73a73-3c91-4522-aeda-7d515578d4d5" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-quobyte-96e73a73-3c91-4522-aeda-7d515578d4d5" acquired by "delete_volume" :: waited 0.028s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:27 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5c085c-f8e8-4cd5-b06a-b696da050347]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:27 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 Jul 03 16:26:27 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:28 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6" returned: 0 in 1.459s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:28 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6 Jul 03 16:26:28 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:28 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f 1073741824" returned: 0 in 1.502s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:28 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5" returned: 0 in 1.355s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:28 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5 Jul 03 16:26:28 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:28 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f Jul 03 16:26:28 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:29 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da1cb6ce-9aad-404b-a17a-4d6b768927b6" returned: 0 in 1.002s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Lock "cinder-quobyte-da1cb6ce-9aad-404b-a17a-4d6b768927b6" released by "delete_volume" :: held 2.547s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Created reservations ['dde94bc1-aed7-4dc0-85a5-7bce528028b0', '048a6d00-a616-45b2-a35a-c6746e04e6fb', 'b2b8a197-df0f-4dad-afc5-2000da0e5c01', 'd201c4fd-2ede-40a5-80f0-48f278f94231'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:29 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:29 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:29 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-96e73a73-3c91-4522-aeda-7d515578d4d5" returned: 0 in 1.162s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-quobyte-96e73a73-3c91-4522-aeda-7d515578d4d5" released by "delete_volume" :: held 2.606s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:29 devstack cinder-volume[86659]: WARNING cinder.quota [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1683509909-1862054780 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1683509909-1862054780, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:26:29 devstack cinder-volume[86659]: WARNING cinder.quota [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1683509909-1862054780 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1683509909-1862054780, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Created reservations ['ecaa2eaf-2fb5-4b1a-8a7f-500be6fcc5eb', '9cec7f3e-66d9-4fb2-8bea-88c46a579bd7', '2cf3b4e5-4faf-4f8c-9b47-b6fba3331104', 'b436b0f2-d0d1-4a7e-8731-c01977a06848'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:29 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f" returned: 0 in 1.292s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] <== create_volume: return (2906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.909s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab0d9ae-d664-421e-bb11-d3a9f3f62095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe08381-8968-4201-a8da-2486cba6fe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:29 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Volume volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f (6b13a085-9495-46a1-9b91-45f8cbb57d9f): created successfully Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe08381-8968-4201-a8da-2486cba6fe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Flow 'volume_create_manager' (62a65952-25f5-4ce6-891c-c47ed9c40a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-30b0f783-16cb-4934-8e8d-d315629a9d6e tempest-VolumesListTestJSON-141396004 None] Created volume successfully. Jul 03 16:26:29 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:29 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:30 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.544s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:30 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:30 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Deleted volume successfully. Jul 03 16:26:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6d45e9aa-3bed-4a16-a411-eddeba5c3e92 tempest-VolumeQuotasAdminTestJSON-1368974656 None] Lock "cinder-da1cb6ce-9aad-404b-a17a-4d6b768927b6-delete_volume" released by "delete_volume" :: held 4.536s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:31 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.471s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:31 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:31 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Deleted volume successfully. Jul 03 16:26:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b5eb80c1-ce28-4fac-b45d-9f8ce418630b tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-96e73a73-3c91-4522-aeda-7d515578d4d5-delete_volume" released by "delete_volume" :: held 4.486s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Acquiring lock "cinder-6b13a085-9495-46a1-9b91-45f8cbb57d9f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Lock "cinder-6b13a085-9495-46a1-9b91-45f8cbb57d9f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Acquiring lock "cinder-quobyte-6b13a085-9495-46a1-9b91-45f8cbb57d9f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Lock "cinder-quobyte-6b13a085-9495-46a1-9b91-45f8cbb57d9f" acquired by "delete_volume" :: waited 0.052s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[79202e2d-3e70-4be7-976f-a1f8d2bb1a8b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:34 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f Jul 03 16:26:34 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:35 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f" returned: 0 in 1.198s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:35 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f Jul 03 16:26:35 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:36 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6b13a085-9495-46a1-9b91-45f8cbb57d9f" returned: 0 in 0.879s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Lock "cinder-quobyte-6b13a085-9495-46a1-9b91-45f8cbb57d9f" released by "delete_volume" :: held 2.165s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:36 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Created reservations ['3b3e5517-6bbe-498a-8885-432deb59c9f3', '750a1749-5066-4fc8-b61f-644c4b858b0f', 'cab406a8-80fd-4df2-bb7f-1006a83c087d', '1775341e-c367-44c4-81bf-cfc2bd572eb3'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:36 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:36 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:37 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.832s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:37 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Deleted volume successfully. Jul 03 16:26:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0c241f5f-cd1b-4455-a781-45357c7809f4 tempest-VolumesListTestJSON-141396004 None] Lock "cinder-6b13a085-9495-46a1-9b91-45f8cbb57d9f-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Acquiring lock "cinder-01038f5a-8003-4360-adc9-f1a4ed616be2-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Lock "cinder-01038f5a-8003-4360-adc9-f1a4ed616be2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Acquiring lock "cinder-quobyte-01038f5a-8003-4360-adc9-f1a4ed616be2" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Lock "cinder-quobyte-01038f5a-8003-4360-adc9-f1a4ed616be2" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:37 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ab7817-e557-4991-9b50-c59e0d0707de]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:37 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2 Jul 03 16:26:37 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:38 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2" returned: 0 in 1.137s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:38 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2 Jul 03 16:26:38 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-5283f1f5-ff64-4b53-819d-78e761367fba req-9e213b8e-3183-4d19-8e05-10413bd3d09c tempest-TestInstancesWithCinderVolumes-1394990013 None] Terminate volume connection completed successfully. Jul 03 16:26:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-5283f1f5-ff64-4b53-819d-78e761367fba req-9e213b8e-3183-4d19-8e05-10413bd3d09c tempest-TestInstancesWithCinderVolumes-1394990013 None] Deleting attachment 14095cb9-3f88-40c6-8857-cdc0d21f5c68. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:26:39 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-01038f5a-8003-4360-adc9-f1a4ed616be2" returned: 0 in 0.914s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Lock "cinder-quobyte-01038f5a-8003-4360-adc9-f1a4ed616be2" released by "delete_volume" :: held 2.115s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:39 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Created reservations ['e4f0100f-ce14-42ad-b40b-1911a54da008', '9333d6b9-d5f1-4a12-8256-6d328562220e', '3e1ea01a-72c7-4dd5-ae78-0d244c7da548', '4cb74a2f-2c14-4653-9208-30188e97dd50'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:40 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:40 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:40 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.833s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:40 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:40 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Deleted volume successfully. Jul 03 16:26:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a728cb68-e334-406d-be5a-486bf3ab000f tempest-VolumesListTestJSON-141396004 None] Lock "cinder-01038f5a-8003-4360-adc9-f1a4ed616be2-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Acquiring lock "cinder-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Lock "cinder-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Acquiring lock "cinder-quobyte-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Lock "cinder-quobyte-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:41 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[15785c12-999f-414d-b998-e0485902f9da]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:41 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d Jul 03 16:26:41 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:42 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d" returned: 0 in 0.988s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:42 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d Jul 03 16:26:42 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:43 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d" returned: 0 in 0.780s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Lock "cinder-quobyte-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d" released by "delete_volume" :: held 1.832s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Created reservations ['528ef8c9-e78e-466c-903f-50bce58c1946', 'a41eb389-e09b-46f1-b79a-c13db68cb93c', 'be450fd4-9d36-4cb9-af20-e8e2e99bfe9a', '51ae25c5-19fb-4088-b44f-6c6ef1f252c4'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:43 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:43 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "cinder-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "cinder-quobyte-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-quobyte-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" acquired by "delete_volume" :: waited 0.051s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:44 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.957s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:44 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Deleted volume successfully. Jul 03 16:26:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a616954f-aaf4-4823-b4f8-a59b2cfbce5d tempest-VolumesListTestJSON-141396004 None] Lock "cinder-ea4bf953-c613-4edd-9dcd-e743b7ec0c8d-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4092143b-2fce-4f8b-904a-df2a4b8bd14e]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:44 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded Jul 03 16:26:44 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:45 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" returned: 0 in 1.248s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:45 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded Jul 03 16:26:45 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:46 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" returned: 1 in 0.900s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:26:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:46 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded Jul 03 16:26:46 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:47 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" returned: 0 in 0.859s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-quobyte-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded" released by "delete_volume" :: held 3.145s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:47 devstack cinder-volume[86659]: WARNING cinder.quota [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1875291275-1263310915 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1875291275-1263310915, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:26:47 devstack cinder-volume[86659]: WARNING cinder.quota [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1875291275-1263310915 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1875291275-1263310915, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:26:47 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Created reservations ['5451d634-d8d1-4b1a-8248-2a126b298fa9', '5725b590-84d8-4a27-a56e-bdabde0b3b4a', 'd0579e2b-54a3-466f-b096-ef5c61df4086', 'c505f077-ed6e-49fa-bd73-5a3178ac0893'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:26:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:47 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:26:47 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:48 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.904s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:26:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Deleted volume successfully. Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f77da0c7-1fa1-4c97-bd72-95ce6d1e5652 tempest-TestInstancesWithCinderVolumes-1394990013 None] Lock "cinder-209eb3f6-ca26-45f5-a9a8-fa82b7c81ded-delete_volume" released by "delete_volume" :: held 4.519s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Flow 'volume_create_manager' (a3f54531-6746-46f3-a540-d8332342f304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a264202a-b330-40ef-877a-5d712ac070f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a264202a-b330-40ef-877a-5d712ac070f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1540509735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24f89ad-d4cc-46e8-8b8b-422ad1493fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac348081045a475fab573399e92b47e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:49Z,use_quota=True,user_id='40b5fe654d464c11836dce8d65a373d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b046a762-d0cb-4387-9683-d17f362469fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b046a762-d0cb-4387-9683-d17f362469fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72000958-1e16-4457-81b0-0c5f2fbb140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72000958-1e16-4457-81b0-0c5f2fbb140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e24f89ad-d4cc-46e8-8b8b-422ad1493fa5', 'volume_name': 'volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5', 'volume_size': 2}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69b9be5-c481-4b6a-8bcc-3c91d4c1e5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69b9be5-c481-4b6a-8bcc-3c91d4c1e5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff187144-29f2-4d36-bc56-d36b467951d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:48 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Volume e24f89ad-d4cc-46e8-8b8b-422ad1493fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5', 'volume_size': 2} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1540509735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24f89ad-d4cc-46e8-8b8b-422ad1493fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac348081045a475fab573399e92b47e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:26:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:26:49Z,use_quota=True,user_id='40b5fe654d464c11836dce8d65a373d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Creating volume e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:26:48 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:26:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 2147483648 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:48 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 2147483648 Jul 03 16:26:48 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:50 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 2147483648" returned: 0 in 1.393s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:50 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 Jul 03 16:26:50 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:51 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" returned: 0 in 1.014s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] <== create_volume: return (2544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:26:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.547s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff187144-29f2-4d36-bc56-d36b467951d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5', 'volume_size': 2}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919f865a-e580-40e4-a6e4-71c34f9ae0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:26:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Volume volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 (e24f89ad-d4cc-46e8-8b8b-422ad1493fa5): created successfully Jul 03 16:26:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919f865a-e580-40e4-a6e4-71c34f9ae0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:26:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Flow 'volume_create_manager' (a3f54531-6746-46f3-a540-d8332342f304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:26:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-89cd1be6-8de9-4cf6-aa9b-c290babf2f56 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Created volume successfully. Jul 03 16:26:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:26:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:26:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Creating offline snapshot cd1ad437-c50c-42e8-bfce-13ab67b9623c of volume e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:26:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d104b8b-9610-4963-b6c1-3cd2530f3a2c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:52 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 Jul 03 16:26:52 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:53 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" returned: 0 in 1.075s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c 2G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:53 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c 2G Jul 03 16:26:53 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:54 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c 2G" returned: 0 in 1.193s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:54 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c Jul 03 16:26:54 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:55 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c" returned: 0 in 0.887s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:55 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c is being set with open permissions: ugo+rw Jul 03 16:26:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:55 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c Jul 03 16:26:55 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:56 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c" returned: 0 in 0.865s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:56 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.info Jul 03 16:26:56 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:57 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.info" returned: 0 in 0.857s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:57 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.info is being set with open permissions: ugo+rw Jul 03 16:26:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:57 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.info Jul 03 16:26:57 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:26:58 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 03 16:26:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.info" returned: 0 in 0.834s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:26:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.835s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:26:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1e14b596-5ee9-4983-acf2-dd1a35535ef6 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Create snapshot completed successfully Jul 03 16:26:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Acquiring lock "cinder-cd1ad437-c50c-42e8-bfce-13ab67b9623c-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-cd1ad437-c50c-42e8-bfce-13ab67b9623c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Acquiring lock "cinder-quobyte-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-quobyte-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Acquiring lock "cinder-quobyte-cd1ad437-c50c-42e8-bfce-13ab67b9623c" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:26:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-quobyte-cd1ad437-c50c-42e8-bfce-13ab67b9623c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:26:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Deleting offline snapshot cd1ad437-c50c-42e8-bfce-13ab67b9623c of volume e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:26:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] snapshot_file for this snap is: volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:26:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7641649-0e31-4f9f-ac52-c4e373c1ec46]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:26:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:26:59 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c Jul 03 16:26:59 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:01 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c" returned: 0 in 1.955s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:27:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90ce7a9-6ccc-4cbd-b3c1-a2045b341a7e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:27:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:01 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 Jul 03 16:27:01 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:02 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" returned: 0 in 1.305s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:02 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c Jul 03 16:27:02 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:03 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c" returned: 0 in 1.543s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:04 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c Jul 03 16:27:04 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:04 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5.cd1ad437-c50c-42e8-bfce-13ab67b9623c" returned: 0 in 0.944s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:04 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=78,cinder:INSERT=29,cinder:UPDATE=124,cinder:DELETE=10 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:27:04 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=93,cinder:INSERT=27,cinder:UPDATE=111,cinder:DELETE=9 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:27:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-quobyte-cd1ad437-c50c-42e8-bfce-13ab67b9623c" released by "_delete_snapshot" :: held 5.949s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-quobyte-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" released by "delete_snapshot" :: held 6.004s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:05 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Created reservations ['c3c86cb3-c8cb-4116-a068-b87bdf98622c', '265605bc-3905-4074-ba2c-24b26a752c9d', 'a86456e9-1636-44e2-970e-3a2f2878b565', '9f6c5dab-9170-4cc0-a1d7-8e2bb8d3bf81'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:27:05 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Delete snapshot completed successfully. Jul 03 16:27:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-33898227-2aa4-43e2-94d6-e536313243ab tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-cd1ad437-c50c-42e8-bfce-13ab67b9623c-delete_snapshot" released by "delete_snapshot" :: held 6.324s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Acquiring lock "cinder-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Acquiring lock "cinder-quobyte-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-quobyte-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" acquired by "delete_volume" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:05 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6925d7bf-9f80-4f2e-91cd-cbc5e2ab6613]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:27:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:06 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 Jul 03 16:27:06 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:07 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" returned: 0 in 1.336s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:07 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5 Jul 03 16:27:07 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:08 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" returned: 0 in 1.079s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-quobyte-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5" released by "delete_volume" :: held 2.545s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:08 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Created reservations ['44433609-c3f4-47f0-a40b-da6063c8b3f4', 'a8d920af-c113-432d-9dfb-177bb3c3f6fa', '347181f1-593d-4143-8d1d-9091e436aaeb', 'a922603d-188a-42f4-94aa-e748213736e5'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:27:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:08 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:27:08 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:09 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.056s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:27:09 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Deleted volume successfully. Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Flow 'volume_create_manager' (463564fc-1a0b-4a20-89a8-fe6aa79cc0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55219303-9a73-439a-afde-d94d0bea1f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-98a43660-3160-4895-a7b4-084923097553 tempest-VolumesSnapshotNegativeTestJSON-755830549 None] Lock "cinder-e24f89ad-d4cc-46e8-8b8b-422ad1493fa5-delete_volume" released by "delete_volume" :: held 4.172s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55219303-9a73-439a-afde-d94d0bea1f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1244776413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff1792b-c727-4f15-aa8d-0117c44aebea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab87ce105b447a909369e2d4556f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:10Z,use_quota=True,user_id='ebbe3912717c4ec5b3e7d8b214cc4b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c441a1-f16e-4165-98a7-b344b685e29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c441a1-f16e-4165-98a7-b344b685e29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739be75f-0958-480c-b2b7-acde248f389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739be75f-0958-480c-b2b7-acde248f389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff1792b-c727-4f15-aa8d-0117c44aebea', 'volume_name': 'volume-cff1792b-c727-4f15-aa8d-0117c44aebea', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a76969-3afd-4563-a611-6dbdf520c7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a76969-3afd-4563-a611-6dbdf520c7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfbbe58-8982-4963-894c-19c396f649b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:09 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Volume cff1792b-c727-4f15-aa8d-0117c44aebea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff1792b-c727-4f15-aa8d-0117c44aebea', 'volume_size': 1} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1244776413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff1792b-c727-4f15-aa8d-0117c44aebea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab87ce105b447a909369e2d4556f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:10Z,use_quota=True,user_id='ebbe3912717c4ec5b3e7d8b214cc4b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Creating volume cff1792b-c727-4f15-aa8d-0117c44aebea {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:27:09 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:27:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:10 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea 1073741824 Jul 03 16:27:10 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:11 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea 1073741824" returned: 0 in 1.308s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:11 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea Jul 03 16:27:11 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:12 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea" returned: 0 in 0.914s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] <== create_volume: return (2277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:27:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfbbe58-8982-4963-894c-19c396f649b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff1792b-c727-4f15-aa8d-0117c44aebea', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a109de9-ae3f-4d9c-b7ff-ebec0ff70278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:12 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Volume volume-cff1792b-c727-4f15-aa8d-0117c44aebea (cff1792b-c727-4f15-aa8d-0117c44aebea): created successfully Jul 03 16:27:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a109de9-ae3f-4d9c-b7ff-ebec0ff70278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Flow 'volume_create_manager' (463564fc-1a0b-4a20-89a8-fe6aa79cc0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a85529c5-6457-4935-81e3-585016cc534a tempest-VolumesListAdminTestJSON-102789150 None] Created volume successfully. Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Flow 'volume_create_manager' (1ccf1762-89a0-4f53-9ee1-6eb2305c310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9849e5b1-8262-4dd2-84d4-0d53dde4f246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9849e5b1-8262-4dd2-84d4-0d53dde4f246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1149417108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e69b11-4098-4cfd-becb-fbfac4492bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab87ce105b447a909369e2d4556f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:14Z,use_quota=True,user_id='ebbe3912717c4ec5b3e7d8b214cc4b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88053bf-6bfb-48cd-bad4-691999e26331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88053bf-6bfb-48cd-bad4-691999e26331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572b28e9-665b-4452-b9de-169a869d2ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572b28e9-665b-4452-b9de-169a869d2ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e69b11-4098-4cfd-becb-fbfac4492bdc', 'volume_name': 'volume-41e69b11-4098-4cfd-becb-fbfac4492bdc', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10119a5-0970-4f0d-bc26-5d9ed5810f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10119a5-0970-4f0d-bc26-5d9ed5810f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c993c7-029a-4bbb-8441-1c5fdfd03725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:14 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Volume 41e69b11-4098-4cfd-becb-fbfac4492bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e69b11-4098-4cfd-becb-fbfac4492bdc', 'volume_size': 1} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1149417108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e69b11-4098-4cfd-becb-fbfac4492bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab87ce105b447a909369e2d4556f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:14Z,use_quota=True,user_id='ebbe3912717c4ec5b3e7d8b214cc4b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Creating volume 41e69b11-4098-4cfd-becb-fbfac4492bdc {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:27:14 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:27:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:14 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc 1073741824 Jul 03 16:27:14 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:15 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc 1073741824" returned: 0 in 1.190s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:15 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc Jul 03 16:27:15 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:16 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc" returned: 0 in 0.871s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:27:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c993c7-029a-4bbb-8441-1c5fdfd03725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e69b11-4098-4cfd-becb-fbfac4492bdc', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26765d3e-1243-4e93-9b07-14484486150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:16 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Volume volume-41e69b11-4098-4cfd-becb-fbfac4492bdc (41e69b11-4098-4cfd-becb-fbfac4492bdc): created successfully Jul 03 16:27:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26765d3e-1243-4e93-9b07-14484486150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Flow 'volume_create_manager' (1ccf1762-89a0-4f53-9ee1-6eb2305c310e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:16 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2149527c-f09b-4b17-9bab-c9b8334087f1 tempest-VolumesListAdminTestJSON-102789150 None] Created volume successfully. Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Flow 'volume_create_manager' (e7f1d389-0a08-4e2a-a2b6-9c9a69b95c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5947e97f-11be-4634-94f4-76d1d42225b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5947e97f-11be-4634-94f4-76d1d42225b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1615474087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5b9112-1d7f-445a-9ba5-77d53594f97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab87ce105b447a909369e2d4556f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:18Z,use_quota=True,user_id='ebbe3912717c4ec5b3e7d8b214cc4b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f59c8a8-6325-4196-9228-f5eed6c0ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f59c8a8-6325-4196-9228-f5eed6c0ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058477ee-d58b-4d20-b625-7e0551e29e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058477ee-d58b-4d20-b625-7e0551e29e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5b9112-1d7f-445a-9ba5-77d53594f97c', 'volume_name': 'volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1272587d-6f8f-4899-8da8-1ecf8f6d16b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1272587d-6f8f-4899-8da8-1ecf8f6d16b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960bb0fe-33ee-49b5-ae30-ed7fbd9903a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:17 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Volume 5e5b9112-1d7f-445a-9ba5-77d53594f97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c', 'volume_size': 1} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1615474087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5b9112-1d7f-445a-9ba5-77d53594f97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab87ce105b447a909369e2d4556f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:18Z,use_quota=True,user_id='ebbe3912717c4ec5b3e7d8b214cc4b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Creating volume 5e5b9112-1d7f-445a-9ba5-77d53594f97c {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:27:18 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:18 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c 1073741824 Jul 03 16:27:18 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:19 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:27:19 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:19 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c 1073741824" returned: 0 in 1.328s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:19 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c Jul 03 16:27:19 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:19 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.973s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:27:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:27:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:27:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:27:20 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c" returned: 0 in 0.979s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] <== create_volume: return (2387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:27:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960bb0fe-33ee-49b5-ae30-ed7fbd9903a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436042ce-ac10-4926-ad7a-b2d0ce22bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:20 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Volume volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c (5e5b9112-1d7f-445a-9ba5-77d53594f97c): created successfully Jul 03 16:27:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436042ce-ac10-4926-ad7a-b2d0ce22bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Flow 'volume_create_manager' (e7f1d389-0a08-4e2a-a2b6-9c9a69b95c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:20 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-5706433a-d9c7-4978-a5f8-bd9d732d20c7 tempest-VolumesListAdminTestJSON-102789150 None] Created volume successfully. Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Flow 'volume_create_manager' (ddc257c9-069b-4b54-be2d-4df510630a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32fcf75-f123-45a9-9450-b85e0a38e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32fcf75-f123-45a9-9450-b85e0a38e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6136f6ce-f3c0-4d02-b2f3-f1007f73c522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca91039323e41ab88a8f58da4181874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:22Z,use_quota=True,user_id='65d3f092141d4449a5d0254c4feab72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938adf3a-e3c3-47d3-a269-a493586833ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938adf3a-e3c3-47d3-a269-a493586833ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd53966-35b7-431c-82c0-7f903d9e27f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd53966-35b7-431c-82c0-7f903d9e27f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6136f6ce-f3c0-4d02-b2f3-f1007f73c522', 'volume_name': 'volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8007855a-c109-4dee-ac12-a879ce6cd91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8007855a-c109-4dee-ac12-a879ce6cd91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16372e39-b60c-4571-8299-ddcf47f7ebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:22 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Volume 6136f6ce-f3c0-4d02-b2f3-f1007f73c522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522', 'volume_size': 1} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6136f6ce-f3c0-4d02-b2f3-f1007f73c522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca91039323e41ab88a8f58da4181874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:22Z,use_quota=True,user_id='65d3f092141d4449a5d0254c4feab72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Creating volume 6136f6ce-f3c0-4d02-b2f3-f1007f73c522 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:27:22 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:27:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:22 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 1073741824 Jul 03 16:27:22 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:23 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 1073741824" returned: 0 in 1.184s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:23 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 Jul 03 16:27:23 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:24 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522" returned: 0 in 0.977s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:27:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16372e39-b60c-4571-8299-ddcf47f7ebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22880ef7-ac4b-4b61-8765-b9f4d9c0009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:24 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Volume volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 (6136f6ce-f3c0-4d02-b2f3-f1007f73c522): created successfully Jul 03 16:27:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22880ef7-ac4b-4b61-8765-b9f4d9c0009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Flow 'volume_create_manager' (ddc257c9-069b-4b54-be2d-4df510630a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:24 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-43396c2e-2524-4de1-b43f-7afbcdb68fc7 tempest-VolumesListAdminTestJSON-692426818 None] Created volume successfully. Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Acquiring lock "cinder-6136f6ce-f3c0-4d02-b2f3-f1007f73c522-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Lock "cinder-6136f6ce-f3c0-4d02-b2f3-f1007f73c522-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Acquiring lock "cinder-quobyte-6136f6ce-f3c0-4d02-b2f3-f1007f73c522" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Lock "cinder-quobyte-6136f6ce-f3c0-4d02-b2f3-f1007f73c522" acquired by "delete_volume" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac8b63a-0c36-48c0-b3fd-91f4a285c106]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "cinder-5e5b9112-1d7f-445a-9ba5-77d53594f97c-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-5e5b9112-1d7f-445a-9ba5-77d53594f97c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "cinder-quobyte-5e5b9112-1d7f-445a-9ba5-77d53594f97c" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:25 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-quobyte-5e5b9112-1d7f-445a-9ba5-77d53594f97c" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:25 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bcfc0c-bb91-4d54-b28b-9a31f22275aa]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:27:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:26 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c Jul 03 16:27:26 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:26 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522" returned: 0 in 1.052s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:26 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522 Jul 03 16:27:26 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:26 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c" returned: 0 in 1.065s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:27 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c Jul 03 16:27:27 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:27 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6136f6ce-f3c0-4d02-b2f3-f1007f73c522" returned: 0 in 0.952s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:27 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Lock "cinder-quobyte-6136f6ce-f3c0-4d02-b2f3-f1007f73c522" released by "delete_volume" :: held 2.076s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:27 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Created reservations ['528ca221-f8f7-4d82-9f38-14fa5f16c86b', '21abd49e-29e9-4a8a-a97a-b6d933d590f1', '038511fb-c818-47b3-8cdc-e7a932465c5f', 'c3555e76-f931-488e-bd7e-3453431f569b'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:27:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:27 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:27:27 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:27 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5e5b9112-1d7f-445a-9ba5-77d53594f97c" returned: 0 in 1.026s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-quobyte-5e5b9112-1d7f-445a-9ba5-77d53594f97c" released by "delete_volume" :: held 2.177s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Created reservations ['3ca01a8c-0e4b-47e7-9455-170fb271d35e', 'e3d4b1c9-bf9b-4b97-a996-827f2eeae6c6', 'ab9faab5-de4d-46f8-91d4-9386be28aa9f', 'e0689624-9654-491f-b4f1-28bcc9f4904d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:28 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:27:28 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:28 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.969s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:27:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Deleted volume successfully. Jul 03 16:27:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-800fd7bf-f995-4696-8286-3371e403663b tempest-VolumesListAdminTestJSON-692426818 None] Lock "cinder-6136f6ce-f3c0-4d02-b2f3-f1007f73c522-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:29 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.208s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:29 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:27:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Deleted volume successfully. Jul 03 16:27:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b01a5539-291f-4199-85c3-92067778340e tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-5e5b9112-1d7f-445a-9ba5-77d53594f97c-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "cinder-41e69b11-4098-4cfd-becb-fbfac4492bdc-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-41e69b11-4098-4cfd-becb-fbfac4492bdc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "cinder-quobyte-41e69b11-4098-4cfd-becb-fbfac4492bdc" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-quobyte-41e69b11-4098-4cfd-becb-fbfac4492bdc" acquired by "delete_volume" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:29 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[157a3618-bffa-4fe9-b8e1-ca261b21f660]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:27:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:29 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc Jul 03 16:27:29 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:31 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc" returned: 0 in 1.432s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:31 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc Jul 03 16:27:31 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Flow 'volume_create_manager' (f8d73ec5-7a53-4509-9696-5ce3ac7a9735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7702e7b0-e4e2-40c7-af53-be2f8bb95578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7702e7b0-e4e2-40c7-af53-be2f8bb95578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-166613407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0bf382-8697-49da-bb43-98f5d131ad25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bcbb133aa946cea420cea8e4091760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:31Z,use_quota=True,user_id='8c75d17e02674809b85463932fe04e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28227ed9-a14c-4ea0-b73b-25310978dba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28227ed9-a14c-4ea0-b73b-25310978dba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccf77f3-7bc9-4bcb-a2ed-851ca4adbe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccf77f3-7bc9-4bcb-a2ed-851ca4adbe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0bf382-8697-49da-bb43-98f5d131ad25', 'volume_name': 'volume-ca0bf382-8697-49da-bb43-98f5d131ad25', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66d2bf3-4359-443c-988c-bcc361e9bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66d2bf3-4359-443c-988c-bcc361e9bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c1a82-202b-4e8a-89d7-5065b7e6a55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:31 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Volume ca0bf382-8697-49da-bb43-98f5d131ad25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0bf382-8697-49da-bb43-98f5d131ad25', 'volume_size': 1} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-166613407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0bf382-8697-49da-bb43-98f5d131ad25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72bcbb133aa946cea420cea8e4091760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:31Z,use_quota=True,user_id='8c75d17e02674809b85463932fe04e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Creating volume ca0bf382-8697-49da-bb43-98f5d131ad25 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:27:31 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:27:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:31 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 1073741824 Jul 03 16:27:31 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:32 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-41e69b11-4098-4cfd-becb-fbfac4492bdc" returned: 0 in 1.015s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-quobyte-41e69b11-4098-4cfd-becb-fbfac4492bdc" released by "delete_volume" :: held 2.514s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:32 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Created reservations ['c4117df3-a229-4a97-8822-71feb922055d', 'ca6fb6e1-c715-4c45-ab65-e312e3c7f01f', '75fc8e58-cd84-4c38-938e-41854b716b4f', 'b274a742-1f04-4314-a204-f75ea122322c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:27:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:32 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:27:32 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "cinder-cff1792b-c727-4f15-aa8d-0117c44aebea-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:33 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 1073741824" returned: 0 in 1.487s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-cff1792b-c727-4f15-aa8d-0117c44aebea-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "cinder-quobyte-cff1792b-c727-4f15-aa8d-0117c44aebea" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-quobyte-cff1792b-c727-4f15-aa8d-0117c44aebea" acquired by "delete_volume" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1b3b4a-7db0-44fd-a7c7-a3c90d351da8]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:33 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 Jul 03 16:27:33 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:33 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.986s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:27:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Deleted volume successfully. Jul 03 16:27:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9467fc89-87fc-4317-b582-b59c1c57f02c tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-41e69b11-4098-4cfd-becb-fbfac4492bdc-delete_volume" released by "delete_volume" :: held 3.934s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:33 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea Jul 03 16:27:33 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:34 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25" returned: 0 in 0.895s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] <== create_volume: return (2527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:27:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.530s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c1a82-202b-4e8a-89d7-5065b7e6a55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0bf382-8697-49da-bb43-98f5d131ad25', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5153cd-d82a-4807-bdac-f3d274b8da73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:34 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Volume volume-ca0bf382-8697-49da-bb43-98f5d131ad25 (ca0bf382-8697-49da-bb43-98f5d131ad25): created successfully Jul 03 16:27:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5153cd-d82a-4807-bdac-f3d274b8da73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Flow 'volume_create_manager' (f8d73ec5-7a53-4509-9696-5ce3ac7a9735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4c5d95df-206d-4c1c-80c7-f47b1eb1042a tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Created volume successfully. Jul 03 16:27:34 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea" returned: 0 in 1.183s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:34 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea Jul 03 16:27:34 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:35 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cff1792b-c727-4f15-aa8d-0117c44aebea" returned: 0 in 1.048s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-quobyte-cff1792b-c727-4f15-aa8d-0117c44aebea" released by "delete_volume" :: held 2.304s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:35 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Created reservations ['d191da24-72c6-4dde-8ba2-f92b8afdaf8c', '4c53e5d0-a472-47c6-87ff-f4b91dbeb14a', '1229821e-b6f4-40e8-83c4-b6ba61e56272', 'ef9bee8e-f402-46fd-87b0-3a73130abe8e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:27:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:35 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:27:35 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:36 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.915s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:36 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:27:36 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Deleted volume successfully. Jul 03 16:27:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c91f0ae1-a5cb-4dc2-8f2d-0e2e16b92036 tempest-VolumesListAdminTestJSON-102789150 None] Lock "cinder-cff1792b-c727-4f15-aa8d-0117c44aebea-delete_volume" released by "delete_volume" :: held 3.621s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-4c66fec6-f595-4362-b33e-da175cc1a4f1 req-c57e5a2a-c2bd-4dc5-8e8c-0208b2cb8938 tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-4c66fec6-f595-4362-b33e-da175cc1a4f1 req-c57e5a2a-c2bd-4dc5-8e8c-0208b2cb8938 tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bbb680-5190-4ab6-a368-09c235ac50c8]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:27:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-4c66fec6-f595-4362-b33e-da175cc1a4f1 req-c57e5a2a-c2bd-4dc5-8e8c-0208b2cb8938 tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:38 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 Jul 03 16:27:38 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:39 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-4c66fec6-f595-4362-b33e-da175cc1a4f1 req-c57e5a2a-c2bd-4dc5-8e8c-0208b2cb8938 tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25" returned: 0 in 1.052s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-4c66fec6-f595-4362-b33e-da175cc1a4f1 req-c57e5a2a-c2bd-4dc5-8e8c-0208b2cb8938 tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.080s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-4c66fec6-f595-4362-b33e-da175cc1a4f1 req-c57e5a2a-c2bd-4dc5-8e8c-0208b2cb8938 tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-ca0bf382-8697-49da-bb43-98f5d131ad25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13510ccd-52f4-49a0-9e1d-44a073ea9b34', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:27:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-4c66fec6-f595-4362-b33e-da175cc1a4f1 req-c57e5a2a-c2bd-4dc5-8e8c-0208b2cb8938 tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] attachment_update completed successfully. Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Flow 'volume_create_manager' (5ce7188d-92a2-4243-b55c-712cb165534e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4d7400-d12c-409e-b9fa-d6bb01aa2523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4d7400-d12c-409e-b9fa-d6bb01aa2523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-474687702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c326b0b-5e89-4059-b07e-c68b67f5b175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97abe18d18f34df2ae971903071299ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:43Z,use_quota=True,user_id='643bc77b2e914cfdb04a76d67585a884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1695604-2a88-4d85-acfb-92322942682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1695604-2a88-4d85-acfb-92322942682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846acc18-f3ec-4c5c-a311-c5cc48f7f08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846acc18-f3ec-4c5c-a311-c5cc48f7f08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c326b0b-5e89-4059-b07e-c68b67f5b175', 'volume_name': 'volume-1c326b0b-5e89-4059-b07e-c68b67f5b175', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85ae85f-7f67-4040-b87e-b8382277b567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85ae85f-7f67-4040-b87e-b8382277b567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9763523c-7e1e-48f4-a856-6f46cf4fd656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:42 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Volume 1c326b0b-5e89-4059-b07e-c68b67f5b175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c326b0b-5e89-4059-b07e-c68b67f5b175', 'volume_size': 1} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-474687702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c326b0b-5e89-4059-b07e-c68b67f5b175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97abe18d18f34df2ae971903071299ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:43Z,use_quota=True,user_id='643bc77b2e914cfdb04a76d67585a884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Creating volume 1c326b0b-5e89-4059-b07e-c68b67f5b175 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:27:42 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:27:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:42 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 1073741824 Jul 03 16:27:42 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Flow 'volume_create_manager' (26f5ce7a-c7f6-48f6-bd84-88fe47618221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7339265b-3f2b-4262-91ef-5af187035a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7339265b-3f2b-4262-91ef-5af187035a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-808426331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac8f0fa-2665-4003-ba58-96d71f329b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97abe18d18f34df2ae971903071299ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:43Z,use_quota=True,user_id='643bc77b2e914cfdb04a76d67585a884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81743327-53f5-4933-af81-4469ddafb225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81743327-53f5-4933-af81-4469ddafb225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de57f29e-9cb0-4a53-afce-7d8f6db677cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de57f29e-9cb0-4a53-afce-7d8f6db677cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac8f0fa-2665-4003-ba58-96d71f329b25', 'volume_name': 'volume-6ac8f0fa-2665-4003-ba58-96d71f329b25', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a08efdb-9c21-456a-9931-27bbe75b1815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a08efdb-9c21-456a-9931-27bbe75b1815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148c10f2-21a4-4b3c-9b3c-6a4106c787fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:43 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Volume 6ac8f0fa-2665-4003-ba58-96d71f329b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac8f0fa-2665-4003-ba58-96d71f329b25', 'volume_size': 1} Jul 03 16:27:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:44 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 1073741824" returned: 0 in 1.516s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:44 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 Jul 03 16:27:44 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:45 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175" returned: 0 in 1.050s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] <== create_volume: return (2630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.633s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-808426331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac8f0fa-2665-4003-ba58-96d71f329b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97abe18d18f34df2ae971903071299ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:43Z,use_quota=True,user_id='643bc77b2e914cfdb04a76d67585a884',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Creating volume 6ac8f0fa-2665-4003-ba58-96d71f329b25 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:27:45 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:45 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 1073741824 Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9763523c-7e1e-48f4-a856-6f46cf4fd656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c326b0b-5e89-4059-b07e-c68b67f5b175', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:45 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4179725d-3c00-4914-bd47-ae75d533262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:45 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Volume volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 (1c326b0b-5e89-4059-b07e-c68b67f5b175): created successfully Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4179725d-3c00-4914-bd47-ae75d533262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Flow 'volume_create_manager' (5ce7188d-92a2-4243-b55c-712cb165534e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2985403d-f137-463b-9ec4-2f7cc1f94ad4 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Created volume successfully. Jul 03 16:27:47 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 1073741824" returned: 0 in 1.618s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:47 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 Jul 03 16:27:47 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-771a1074-e178-4ea3-8db5-d80c76823908 req-5268431f-0c6d-4bc2-becb-36a1e6a019c7 tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Terminate volume connection completed successfully. Jul 03 16:27:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-771a1074-e178-4ea3-8db5-d80c76823908 req-5268431f-0c6d-4bc2-becb-36a1e6a019c7 tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Deleting attachment 13510ccd-52f4-49a0-9e1d-44a073ea9b34. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:27:48 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25" returned: 0 in 1.688s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] <== create_volume: return (3390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:27:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.396s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148c10f2-21a4-4b3c-9b3c-6a4106c787fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac8f0fa-2665-4003-ba58-96d71f329b25', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83b95c2-6f3b-494c-96fa-5ec6d5255f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:49 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Volume volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 (6ac8f0fa-2665-4003-ba58-96d71f329b25): created successfully Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83b95c2-6f3b-494c-96fa-5ec6d5255f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Flow 'volume_create_manager' (26f5ce7a-c7f6-48f6-bd84-88fe47618221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ea5dafbb-709a-4e2c-96b3-47ff27d2a4d6 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Created volume successfully. Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Flow 'volume_create_manager' (f2d149fd-db3d-4025-8b98-a2eb556ba3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2086c6b6-b945-4275-949d-7663511e2627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2086c6b6-b945-4275-949d-7663511e2627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1723632108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d17528-2da7-43dc-b5bd-333733f7d09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2499c9fece594b3ebfd62d9879b2cfd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:49Z,use_quota=True,user_id='8451b464f77146d88d6141c77d68998e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3cd1f3-2818-4579-8d1f-f52f4eda72c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3cd1f3-2818-4579-8d1f-f52f4eda72c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce25a936-6a2f-42f7-aadf-4e12b2c073d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce25a936-6a2f-42f7-aadf-4e12b2c073d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d17528-2da7-43dc-b5bd-333733f7d09d', 'volume_name': 'volume-22d17528-2da7-43dc-b5bd-333733f7d09d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796849db-4f83-4afb-ac78-355e155699e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796849db-4f83-4afb-ac78-355e155699e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a90d6f6-1165-4439-81c6-bd8c128edea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:49 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Volume 22d17528-2da7-43dc-b5bd-333733f7d09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d17528-2da7-43dc-b5bd-333733f7d09d', 'volume_size': 1} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1723632108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d17528-2da7-43dc-b5bd-333733f7d09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2499c9fece594b3ebfd62d9879b2cfd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:27:49Z,use_quota=True,user_id='8451b464f77146d88d6141c77d68998e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Creating volume 22d17528-2da7-43dc-b5bd-333733f7d09d {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:27:49 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:27:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:49 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d 1073741824 Jul 03 16:27:49 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Acquiring lock "cinder-ca0bf382-8697-49da-bb43-98f5d131ad25-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "cinder-ca0bf382-8697-49da-bb43-98f5d131ad25-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Acquiring lock "cinder-quobyte-ca0bf382-8697-49da-bb43-98f5d131ad25" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:27:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "cinder-quobyte-ca0bf382-8697-49da-bb43-98f5d131ad25" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:27:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bccc95-2c0d-436e-8a07-3c8af53cad32]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:27:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:51 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d 1073741824" returned: 0 in 1.430s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:51 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 Jul 03 16:27:51 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:51 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d Jul 03 16:27:51 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:51 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d" returned: 0 in 0.772s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a90d6f6-1165-4439-81c6-bd8c128edea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d17528-2da7-43dc-b5bd-333733f7d09d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f2deeb-2754-4e78-8645-9af13d9123e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:27:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Volume volume-22d17528-2da7-43dc-b5bd-333733f7d09d (22d17528-2da7-43dc-b5bd-333733f7d09d): created successfully Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f2deeb-2754-4e78-8645-9af13d9123e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Flow 'volume_create_manager' (f2d149fd-db3d-4025-8b98-a2eb556ba3ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:27:51 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25" returned: 0 in 1.034s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:52 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1f7c7c8f-e23e-492c-9312-2d31f49263ba tempest-SnapshotMetadataTestJSON-896294517 None] Created volume successfully. Jul 03 16:27:52 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25 Jul 03 16:27:52 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:52 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca0bf382-8697-49da-bb43-98f5d131ad25" returned: 0 in 0.834s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "cinder-quobyte-ca0bf382-8697-49da-bb43-98f5d131ad25" released by "delete_volume" :: held 1.938s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:52 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Created reservations ['049b59b1-f6c0-464e-9443-4d11a475bcfe', '48367c37-db7e-4a6b-acd9-581f5861f97c', '5ded9a32-4945-48e7-ae37-dbe69d4caff0', '62d1d5e5-80de-49c7-a815-fb99ca046d1d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:27:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Creating offline snapshot 81879785-90ee-4937-9d20-6d14ff604def of volume 22d17528-2da7-43dc-b5bd-333733f7d09d {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0de522-62cd-4e83-98b7-5e889ee2083b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:53 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:27:53 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:53 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d Jul 03 16:27:53 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:53 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.891s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:27:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Deleted volume successfully. Jul 03 16:27:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cb40e535-16b7-4fab-87f9-9e70a3a7ea7d tempest-TestServerVolumeAttachScenarioOldVersion-1088262118 None] Lock "cinder-ca0bf382-8697-49da-bb43-98f5d131ad25-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:27:54 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d" returned: 0 in 1.044s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:54 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def 1G Jul 03 16:27:54 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:55 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def 1G" returned: 0 in 1.237s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d17528-2da7-43dc-b5bd-333733f7d09d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:55 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d17528-2da7-43dc-b5bd-333733f7d09d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def Jul 03 16:27:55 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:56 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d17528-2da7-43dc-b5bd-333733f7d09d -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def" returned: 0 in 0.884s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:56 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def is being set with open permissions: ugo+rw Jul 03 16:27:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:56 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def Jul 03 16:27:56 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:57 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def" returned: 0 in 0.918s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:57 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.info Jul 03 16:27:57 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:58 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.info" returned: 0 in 0.922s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:58 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.info is being set with open permissions: ugo+rw Jul 03 16:27:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:27:58 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.info Jul 03 16:27:58 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:27:58 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 03 16:27:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.info" returned: 0 in 0.793s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:27:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.950s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:27:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b970d0bb-1727-43a7-a03a-bfd9b630d912 tempest-SnapshotMetadataTestJSON-896294517 None] Create snapshot completed successfully Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Acquiring lock "cinder-81879785-90ee-4937-9d20-6d14ff604def-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-81879785-90ee-4937-9d20-6d14ff604def-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Acquiring lock "cinder-quobyte-22d17528-2da7-43dc-b5bd-333733f7d09d" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-quobyte-22d17528-2da7-43dc-b5bd-333733f7d09d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Acquiring lock "cinder-quobyte-81879785-90ee-4937-9d20-6d14ff604def" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-quobyte-81879785-90ee-4937-9d20-6d14ff604def" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Deleting offline snapshot 81879785-90ee-4937-9d20-6d14ff604def of volume 22d17528-2da7-43dc-b5bd-333733f7d09d {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] snapshot_file for this snap is: volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bb250e-1d65-4207-b00b-b0cf11bf0455]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:00 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def Jul 03 16:28:00 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:01 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def" returned: 0 in 1.108s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22d17528-2da7-43dc-b5bd-333733f7d09d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:28:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eef8c91-3c8f-4e58-a2b7-c69619cb008f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:01 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d Jul 03 16:28:01 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:02 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d" returned: 0 in 1.136s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:02 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def Jul 03 16:28:02 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:03 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def" returned: 0 in 1.012s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:03 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def Jul 03 16:28:03 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:04 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d.81879785-90ee-4937-9d20-6d14ff604def" returned: 0 in 0.765s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-quobyte-81879785-90ee-4937-9d20-6d14ff604def" released by "_delete_snapshot" :: held 4.185s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-quobyte-22d17528-2da7-43dc-b5bd-333733f7d09d" released by "delete_snapshot" :: held 4.218s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:04 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Created reservations ['5a8a5dc8-79ef-47bf-b956-246efef883e1', '719c6aa9-18df-4a12-9e1f-aa7e53fc1597', '32e3da80-5e1a-45cb-ac77-6212f5d29b9b', 'b58f0a0b-2335-4c3f-8d5b-fe71d180450f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:28:04 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Delete snapshot completed successfully. Jul 03 16:28:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6a597ab0-b26a-4914-8159-2a39c610b2ab tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-81879785-90ee-4937-9d20-6d14ff604def-delete_snapshot" released by "delete_snapshot" :: held 4.386s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Acquiring lock "cinder-22d17528-2da7-43dc-b5bd-333733f7d09d-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-22d17528-2da7-43dc-b5bd-333733f7d09d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:06 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=66,cinder:INSERT=23,cinder:UPDATE=99,cinder:DELETE=5 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:28:06 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=68,cinder:INSERT=18,cinder:UPDATE=75,cinder:DELETE=10 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:28:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Acquiring lock "cinder-quobyte-22d17528-2da7-43dc-b5bd-333733f7d09d" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-quobyte-22d17528-2da7-43dc-b5bd-333733f7d09d" acquired by "delete_volume" :: waited 0.064s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:06 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[867f0500-988a-43c8-ab5d-d1202bcf806d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:06 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d Jul 03 16:28:06 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:08 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d" returned: 0 in 2.582s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:08 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d Jul 03 16:28:08 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:10 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-22d17528-2da7-43dc-b5bd-333733f7d09d" returned: 0 in 1.673s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-quobyte-22d17528-2da7-43dc-b5bd-333733f7d09d" released by "delete_volume" :: held 4.362s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:10 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Created reservations ['bf7dd8a2-46a8-42bb-b875-9980525a0e19', 'b93d7795-5d46-4f3e-8c96-684e42b454e4', 'c7cfaa77-199c-46f5-8619-da4888c365df', '71fba6c3-3f3f-4195-9e62-e403e08b256c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:28:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:11 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:28:11 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:13 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.986s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:13 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:28:13 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Deleted volume successfully. Jul 03 16:28:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3c9178af-9746-40dd-9c60-4455b806442d tempest-SnapshotMetadataTestJSON-896294517 None] Lock "cinder-22d17528-2da7-43dc-b5bd-333733f7d09d-delete_volume" released by "delete_volume" :: held 7.179s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:28:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:19 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:28:19 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:19 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:28:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Flow 'volume_create_manager' (ed353d28-8539-42eb-aca8-51bc5b1beb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fa19e2-a10a-4726-a5df-83e12796b2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fa19e2-a10a-4726-a5df-83e12796b2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1918242487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dbf0ea-a0c2-4c7f-8793-719a89373fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380e04faada14c1c99b984186bf80f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:20Z,use_quota=True,user_id='1a9b5b1839244623857a2e14383aa596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301025f8-ad65-43e0-9d57-1008efc67660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301025f8-ad65-43e0-9d57-1008efc67660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f15e828-7fc2-4e5e-8fb8-f2cec0fc6a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f15e828-7fc2-4e5e-8fb8-f2cec0fc6a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49dbf0ea-a0c2-4c7f-8793-719a89373fac', 'volume_name': 'volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e454e742-42e6-4968-8b34-be0fb1135446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e454e742-42e6-4968-8b34-be0fb1135446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b456136e-36ff-4976-a88b-17fd211921ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:20 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Volume 49dbf0ea-a0c2-4c7f-8793-719a89373fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac', 'volume_size': 1} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1918242487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dbf0ea-a0c2-4c7f-8793-719a89373fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='380e04faada14c1c99b984186bf80f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:20Z,use_quota=True,user_id='1a9b5b1839244623857a2e14383aa596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Creating volume 49dbf0ea-a0c2-4c7f-8793-719a89373fac {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:28:20 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:28:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:20 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac 1073741824 Jul 03 16:28:20 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:21 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 2.141s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:21 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:28:21 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:28:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:28:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:28:22 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac 1073741824" returned: 0 in 2.004s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:22 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac Jul 03 16:28:22 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:22 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:28:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Flow 'volume_create_manager' (500b3ccb-e3ee-4359-bdfa-f8e5fad91c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eadbeba-be42-4202-b35c-34f798ec2626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eadbeba-be42-4202-b35c-34f798ec2626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-63131590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da15cbe8-8956-4d74-9cab-a986dcdfdb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc58c262b78b44df8225cec7cccbfb8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:23Z,use_quota=True,user_id='d365e59d8f3c4c528c1aa08b950afbab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c652e9-5174-42b3-baa6-ca66c8905b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c652e9-5174-42b3-baa6-ca66c8905b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf7cdb0-bb16-4cb7-b36b-30ae51e52591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf7cdb0-bb16-4cb7-b36b-30ae51e52591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da15cbe8-8956-4d74-9cab-a986dcdfdb78', 'volume_name': 'volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19222a5-eef4-4e21-bcb4-50b927c8a5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19222a5-eef4-4e21-bcb4-50b927c8a5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c73b679-8196-402a-b9c7-200ef09d3ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:23 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Volume da15cbe8-8956-4d74-9cab-a986dcdfdb78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78', 'volume_size': 1} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:23 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac" returned: 0 in 1.021s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] <== create_volume: return (3165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.169s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-63131590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da15cbe8-8956-4d74-9cab-a986dcdfdb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc58c262b78b44df8225cec7cccbfb8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:23Z,use_quota=True,user_id='d365e59d8f3c4c528c1aa08b950afbab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Creating volume da15cbe8-8956-4d74-9cab-a986dcdfdb78 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:28:23 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b456136e-36ff-4976-a88b-17fd211921ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:23 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 1073741824 Jul 03 16:28:23 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a90a5f-9617-4fb6-a84f-a0ec7b81697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:23 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Volume volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac (49dbf0ea-a0c2-4c7f-8793-719a89373fac): created successfully Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a90a5f-9617-4fb6-a84f-a0ec7b81697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Flow 'volume_create_manager' (ed353d28-8539-42eb-aca8-51bc5b1beb78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:23 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-dea99f23-e4d9-44b4-b14b-0e3df05b4115 tempest-TestMinimumBasicScenario-2080705228 None] Created volume successfully. Jul 03 16:28:24 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 1073741824" returned: 0 in 1.237s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:24 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 Jul 03 16:28:24 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:25 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78" returned: 0 in 0.886s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:28:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.206s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c73b679-8196-402a-b9c7-200ef09d3ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09171fb2-d911-4b5f-adff-651a273b2662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:25 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Volume volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 (da15cbe8-8956-4d74-9cab-a986dcdfdb78): created successfully Jul 03 16:28:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09171fb2-d911-4b5f-adff-651a273b2662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Flow 'volume_create_manager' (500b3ccb-e3ee-4359-bdfa-f8e5fad91c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6c94370d-9871-4cd0-b29c-aca150b4986f tempest-AbsoluteLimitsTests-216330104 None] Created volume successfully. Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Acquiring lock "cinder-da15cbe8-8956-4d74-9cab-a986dcdfdb78-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Lock "cinder-da15cbe8-8956-4d74-9cab-a986dcdfdb78-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Acquiring lock "cinder-quobyte-da15cbe8-8956-4d74-9cab-a986dcdfdb78" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Lock "cinder-quobyte-da15cbe8-8956-4d74-9cab-a986dcdfdb78" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b9a9d4-7180-4f4a-a490-d72aeab31d47]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:26 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 Jul 03 16:28:26 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (812529d0-f8fc-44df-be95-a983dfea5485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58879e7-9f5a-4ceb-ac8d-e033ad8a5851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58879e7-9f5a-4ceb-ac8d-e033ad8a5851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129589359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87b56ac-fcd4-4f43-b6d6-05667d2201b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:27Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb0f1de-90f0-4e71-a8a8-7e6efe78b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb0f1de-90f0-4e71-a8a8-7e6efe78b026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08ebee3-4b65-4202-8fc5-710f963cf044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08ebee3-4b65-4202-8fc5-710f963cf044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b87b56ac-fcd4-4f43-b6d6-05667d2201b9', 'volume_name': 'volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520321c6-8b17-49da-868f-bf8d7ec71591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520321c6-8b17-49da-868f-bf8d7ec71591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ed122f-9354-4834-b363-22dc82582f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume b87b56ac-fcd4-4f43-b6d6-05667d2201b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9', 'volume_size': 1} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129589359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87b56ac-fcd4-4f43-b6d6-05667d2201b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:27Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Creating volume b87b56ac-fcd4-4f43-b6d6-05667d2201b9 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:28:26 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:28:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:26 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 1073741824 Jul 03 16:28:26 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:27 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78" returned: 0 in 0.892s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:27 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78 Jul 03 16:28:27 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-d8530d83-6d16-49d3-86c3-2cfab5db2c70 req-2f1da2fa-4f1d-4b86-9bde-c126c200f43b tempest-TestMinimumBasicScenario-2080705228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:27 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 1073741824" returned: 0 in 1.043s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:27 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 Jul 03 16:28:27 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:28 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-da15cbe8-8956-4d74-9cab-a986dcdfdb78" returned: 0 in 0.763s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Lock "cinder-quobyte-da15cbe8-8956-4d74-9cab-a986dcdfdb78" released by "delete_volume" :: held 1.700s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Created reservations ['2a9d7ea5-e7bd-437a-bb2e-eee23e2fce54', '08047d4f-7ba5-4b7d-8271-f3e43b2da774', 'caf61bcd-afdc-4b5d-b2fd-0bda0f980eaa', '2d700e63-df1f-4ee7-b5e1-7ae780bc3235'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:28 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:28:28 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:28 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" returned: 0 in 0.759s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-d8530d83-6d16-49d3-86c3-2cfab5db2c70 req-2f1da2fa-4f1d-4b86-9bde-c126c200f43b tempest-TestMinimumBasicScenario-2080705228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.917s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ed122f-9354-4834-b363-22dc82582f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a21e97-93bd-4446-aabf-1dcbe2fda866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9cf843-0e64-400b-bc0b-bc2c66814059]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-d8530d83-6d16-49d3-86c3-2cfab5db2c70 req-2f1da2fa-4f1d-4b86-9bde-c126c200f43b tempest-TestMinimumBasicScenario-2080705228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:28 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 (b87b56ac-fcd4-4f43-b6d6-05667d2201b9): created successfully Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a21e97-93bd-4446-aabf-1dcbe2fda866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (812529d0-f8fc-44df-be95-a983dfea5485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b149d8c4-511e-4612-b4e8-77647070b3a2 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created volume successfully. Jul 03 16:28:28 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac Jul 03 16:28:28 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:28 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.820s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:28 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:28:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Deleted volume successfully. Jul 03 16:28:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f5aa3ba5-9a34-4a78-88a5-942d9c5adb7a tempest-AbsoluteLimitsTests-216330104 None] Lock "cinder-da15cbe8-8956-4d74-9cab-a986dcdfdb78-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:29 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-d8530d83-6d16-49d3-86c3-2cfab5db2c70 req-2f1da2fa-4f1d-4b86-9bde-c126c200f43b tempest-TestMinimumBasicScenario-2080705228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac" returned: 0 in 0.929s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-d8530d83-6d16-49d3-86c3-2cfab5db2c70 req-2f1da2fa-4f1d-4b86-9bde-c126c200f43b tempest-TestMinimumBasicScenario-2080705228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-d8530d83-6d16-49d3-86c3-2cfab5db2c70 req-2f1da2fa-4f1d-4b86-9bde-c126c200f43b tempest-TestMinimumBasicScenario-2080705228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63181a1b-5a3c-41aa-8090-f9a6e45ab50b', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:28:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-d8530d83-6d16-49d3-86c3-2cfab5db2c70 req-2f1da2fa-4f1d-4b86-9bde-c126c200f43b tempest-TestMinimumBasicScenario-2080705228 None] attachment_update completed successfully. Jul 03 16:28:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Creating offline snapshot 3c55c4f3-ddc8-47db-99f9-6fe13f09e448 of volume b87b56ac-fcd4-4f43-b6d6-05667d2201b9 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:28:30 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdada68e-5c1e-451a-8e32-39b17f78a117]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:30 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 Jul 03 16:28:30 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:31 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" returned: 0 in 1.079s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:31 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 1G Jul 03 16:28:31 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:32 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 1G" returned: 0 in 1.207s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:32 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 Jul 03 16:28:32 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:33 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448" returned: 0 in 0.869s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:33 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 is being set with open permissions: ugo+rw Jul 03 16:28:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:33 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 Jul 03 16:28:33 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Flow 'volume_create_manager' (4f15dc06-df26-4a40-b403-720b25e0a4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023661c2-f5be-45c4-bf4c-37155baf28c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023661c2-f5be-45c4-bf4c-37155baf28c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1039560665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802e8e25-6910-4de0-be24-30d7804b879c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326e7344ab2f4eecbece6292f88c9555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:34Z,use_quota=True,user_id='ea3d408ed92c413c9b6521f0716b56a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e33a762-5df6-47c8-a9e9-da0bab95735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e33a762-5df6-47c8-a9e9-da0bab95735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56f4fdb-ffa7-4621-bba7-b5bf7770df24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56f4fdb-ffa7-4621-bba7-b5bf7770df24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802e8e25-6910-4de0-be24-30d7804b879c', 'volume_name': 'volume-802e8e25-6910-4de0-be24-30d7804b879c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1e68d2-6294-498b-a506-aa7b3900b027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1e68d2-6294-498b-a506-aa7b3900b027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e946631-170a-4ab0-b713-708449ccddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:34 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Volume 802e8e25-6910-4de0-be24-30d7804b879c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802e8e25-6910-4de0-be24-30d7804b879c', 'volume_size': 1} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:34 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448" returned: 0 in 0.950s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:34 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.info Jul 03 16:28:34 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:35 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.info" returned: 0 in 0.822s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:35 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.info is being set with open permissions: ugo+rw Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:35 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.info Jul 03 16:28:35 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:35 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.info" returned: 0 in 0.704s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.755s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1039560665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802e8e25-6910-4de0-be24-30d7804b879c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326e7344ab2f4eecbece6292f88c9555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:34Z,use_quota=True,user_id='ea3d408ed92c413c9b6521f0716b56a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Creating volume 802e8e25-6910-4de0-be24-30d7804b879c {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:28:35 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:28:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:35 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c 1073741824 Jul 03 16:28:35 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:35 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a2499ed8-db46-40ed-9ab5-d7ff7c379909 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Create snapshot completed successfully Jul 03 16:28:36 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c 1073741824" returned: 0 in 1.049s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (adf9771a-33b2-4bb7-a3c3-b9cc686dd446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca060e98-8927-4b58-b0ea-2edc12215173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca060e98-8927-4b58-b0ea-2edc12215173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314940976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ecf95c-6706-46e7-9a4c-d637e0bcb658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:37Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fe33cc-9867-43b1-a218-6d0d51b1d6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fe33cc-9867-43b1-a218-6d0d51b1d6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c09ff-4a02-4826-89da-491cbbc138f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c09ff-4a02-4826-89da-491cbbc138f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58ecf95c-6706-46e7-9a4c-d637e0bcb658', 'volume_name': 'volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44719dd2-e7b7-4736-8e10-0e6d145aa86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44719dd2-e7b7-4736-8e10-0e6d145aa86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc644ae-c994-42f0-8f32-7d95fc953df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume 58ecf95c-6706-46e7-9a4c-d637e0bcb658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658', 'volume_size': 1} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:37 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c Jul 03 16:28:37 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (6c119f39-ff07-475d-aa8c-a7d8e7935c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f881d75-8434-41af-b42b-9b47cf1642b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f881d75-8434-41af-b42b-9b47cf1642b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-419613948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8588210-04cb-4317-90fc-02995e34bf2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:38Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f7765d-ace7-4823-aa21-627beba0cf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f7765d-ace7-4823-aa21-627beba0cf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75495e7c-72b5-4ba0-afee-f7ae51fdda32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75495e7c-72b5-4ba0-afee-f7ae51fdda32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8588210-04cb-4317-90fc-02995e34bf2f', 'volume_name': 'volume-c8588210-04cb-4317-90fc-02995e34bf2f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9afdbf-505b-49b2-9a46-3bdf4b0bf69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9afdbf-505b-49b2-9a46-3bdf4b0bf69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945dc51e-10d5-4c27-bfad-88a75395c380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume c8588210-04cb-4317-90fc-02995e34bf2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8588210-04cb-4317-90fc-02995e34bf2f', 'volume_size': 1} Jul 03 16:28:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (30959aa9-31a0-4077-bdf8-2e7c5e579226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bda6a3-9c91-48c3-bc36-b8e0cae754a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bda6a3-9c91-48c3-bc36-b8e0cae754a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1770828906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6a3966-65b3-4b78-8b73-fca5d670e72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:38Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9691e05-55fd-4631-86dc-496f1a4e7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9691e05-55fd-4631-86dc-496f1a4e7b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8204281-bc90-47d4-b0b7-f7b9359e395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8204281-bc90-47d4-b0b7-f7b9359e395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6a3966-65b3-4b78-8b73-fca5d670e72d', 'volume_name': 'volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07986fff-bce6-44b9-aad6-f08ab1ddeda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07986fff-bce6-44b9-aad6-f08ab1ddeda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7b8a68-d602-44e5-b37e-a66514b0ba88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume 3b6a3966-65b3-4b78-8b73-fca5d670e72d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d', 'volume_size': 1} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:38 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c" returned: 0 in 1.251s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] <== create_volume: return (2592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.596s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314940976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ecf95c-6706-46e7-9a4c-d637e0bcb658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:37Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Creating volume 58ecf95c-6706-46e7-9a4c-d637e0bcb658 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:28:38 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e946631-170a-4ab0-b713-708449ccddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802e8e25-6910-4de0-be24-30d7804b879c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aaaafe8-7607-4d04-b86e-fd8b9be691ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Volume volume-802e8e25-6910-4de0-be24-30d7804b879c (802e8e25-6910-4de0-be24-30d7804b879c): created successfully Jul 03 16:28:38 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 1073741824 Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aaaafe8-7607-4d04-b86e-fd8b9be691ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:38 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Flow 'volume_create_manager' (4f15dc06-df26-4a40-b403-720b25e0a4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0b8872ac-2e0a-48fd-a7c1-ebb0603bb4fb tempest-VolumesNegativeTest-1383067781 None] Created volume successfully. Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-67eb9739-1904-404d-ac72-f4d38e5478b3 req-dedb925f-add0-4840-8b37-02a77c0138ee tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (89efd1ec-1c46-40ec-bb26-3ad9654508db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf9a936-8bd8-4374-8d2d-a05e7b619ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf9a936-8bd8-4374-8d2d-a05e7b619ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-392408985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c670f6-2888-4d79-98bf-c49f9329ef40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:39Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1732c5-07af-49ea-93d2-e1e758969926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1732c5-07af-49ea-93d2-e1e758969926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff6bfbc-e863-42f9-bf74-710448df15f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff6bfbc-e863-42f9-bf74-710448df15f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c670f6-2888-4d79-98bf-c49f9329ef40', 'volume_name': 'volume-04c670f6-2888-4d79-98bf-c49f9329ef40', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b966406-cc77-4d36-b87d-2760603cdb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b966406-cc77-4d36-b87d-2760603cdb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b95603-6a46-4ed2-9c70-35774f2fb8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:39 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume 04c670f6-2888-4d79-98bf-c49f9329ef40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c670f6-2888-4d79-98bf-c49f9329ef40', 'volume_size': 1} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (e40dabfc-9479-47af-a051-0cb352b4122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042f620d-d711-48d9-9bf5-607f66318ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042f620d-d711-48d9-9bf5-607f66318ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-996122761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020a210a-50c9-4c44-b452-13b606be2645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:39Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f3bd3d-615c-4561-8e31-d8db37768e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f3bd3d-615c-4561-8e31-d8db37768e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf970e75-bcc1-484e-aa81-6baa46b2cf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf970e75-bcc1-484e-aa81-6baa46b2cf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020a210a-50c9-4c44-b452-13b606be2645', 'volume_name': 'volume-020a210a-50c9-4c44-b452-13b606be2645', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a695e27f-2b5e-4013-9a54-943c78c1db4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a695e27f-2b5e-4013-9a54-943c78c1db4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75447b9-d8d5-4253-82b6-498538bb75ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:39 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume 020a210a-50c9-4c44-b452-13b606be2645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020a210a-50c9-4c44-b452-13b606be2645', 'volume_size': 1} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:39 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 1073741824" returned: 0 in 1.289s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:39 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 Jul 03 16:28:39 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:40 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658" returned: 0 in 0.883s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-419613948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8588210-04cb-4317-90fc-02995e34bf2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:38Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Creating volume c8588210-04cb-4317-90fc-02995e34bf2f {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:28:40 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:28:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:40 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f 1073741824 Jul 03 16:28:40 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc644ae-c994-42f0-8f32-7d95fc953df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92e02e9-e441-4089-a670-a9872f0c292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:41 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 (58ecf95c-6706-46e7-9a4c-d637e0bcb658): created successfully Jul 03 16:28:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92e02e9-e441-4089-a670-a9872f0c292a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (adf9771a-33b2-4bb7-a3c3-b9cc686dd446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:41 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-314c834b-ec2d-4770-b68e-7e98f65886c4 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created volume successfully. Jul 03 16:28:41 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f 1073741824" returned: 0 in 1.122s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:42 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f Jul 03 16:28:42 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:42 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f" returned: 0 in 0.795s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.501s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1770828906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6a3966-65b3-4b78-8b73-fca5d670e72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:38Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Creating volume 3b6a3966-65b3-4b78-8b73-fca5d670e72d {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:28:42 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:42 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d 1073741824 Jul 03 16:28:42 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945dc51e-10d5-4c27-bfad-88a75395c380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8588210-04cb-4317-90fc-02995e34bf2f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bed8b0b-ab9d-41be-946f-b093e759dfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:42 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume volume-c8588210-04cb-4317-90fc-02995e34bf2f (c8588210-04cb-4317-90fc-02995e34bf2f): created successfully Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bed8b0b-ab9d-41be-946f-b093e759dfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (6c119f39-ff07-475d-aa8c-a7d8e7935c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:42 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-8cdfd73d-e1ba-4bce-97a1-ff74673c6a6c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created volume successfully. Jul 03 16:28:43 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d 1073741824" returned: 0 in 1.063s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:43 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d Jul 03 16:28:43 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:44 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d" returned: 0 in 0.690s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-67eb9739-1904-404d-ac72-f4d38e5478b3 req-dedb925f-add0-4840-8b37-02a77c0138ee tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.838s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7b8a68-d602-44e5-b37e-a66514b0ba88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7432c037-70af-4ba2-ac85-076bd8fc22bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c054d7-09f2-4d35-841e-37121aa66040]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-67eb9739-1904-404d-ac72-f4d38e5478b3 req-dedb925f-add0-4840-8b37-02a77c0138ee tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:44 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d (3b6a3966-65b3-4b78-8b73-fca5d670e72d): created successfully Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7432c037-70af-4ba2-ac85-076bd8fc22bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (30959aa9-31a0-4077-bdf8-2e7c5e579226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b1d6a96c-cb33-4fd3-930d-b773a4547a60 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created volume successfully. Jul 03 16:28:44 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 Jul 03 16:28:44 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:45 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-67eb9739-1904-404d-ac72-f4d38e5478b3 req-dedb925f-add0-4840-8b37-02a77c0138ee tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175" returned: 0 in 0.857s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-67eb9739-1904-404d-ac72-f4d38e5478b3 req-dedb925f-add0-4840-8b37-02a77c0138ee tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.891s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.450s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-392408985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c670f6-2888-4d79-98bf-c49f9329ef40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:39Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Creating volume 04c670f6-2888-4d79-98bf-c49f9329ef40 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:28:45 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:45 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40 1073741824 Jul 03 16:28:45 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-67eb9739-1904-404d-ac72-f4d38e5478b3 req-dedb925f-add0-4840-8b37-02a77c0138ee tempest-TestServerVolumeAttachmentScenario-1272926891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-1c326b0b-5e89-4059-b07e-c68b67f5b175', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7a12fd0-6571-4b8f-933b-e2ed46c4e952', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:28:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-67eb9739-1904-404d-ac72-f4d38e5478b3 req-dedb925f-add0-4840-8b37-02a77c0138ee tempest-TestServerVolumeAttachmentScenario-1272926891 None] attachment_update completed successfully. Jul 03 16:28:46 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40 1073741824" returned: 0 in 1.098s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:46 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40 Jul 03 16:28:46 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:47 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40" returned: 0 in 0.860s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.035s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-996122761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020a210a-50c9-4c44-b452-13b606be2645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a11837eb1964bbca045603f39aa8930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:28:39Z,use_quota=True,user_id='ce4cd8d97d8a4ba8a6659d53a6a841e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Creating volume 020a210a-50c9-4c44-b452-13b606be2645 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:28:47 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b95603-6a46-4ed2-9c70-35774f2fb8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c670f6-2888-4d79-98bf-c49f9329ef40', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:47 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645 1073741824 Jul 03 16:28:47 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c15500-2168-4551-b106-d2b44438b52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:47 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume volume-04c670f6-2888-4d79-98bf-c49f9329ef40 (04c670f6-2888-4d79-98bf-c49f9329ef40): created successfully Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c15500-2168-4551-b106-d2b44438b52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (89efd1ec-1c46-40ec-bb26-3ad9654508db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:47 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-32c3369b-8e4f-4c56-90d3-8210dc2803f7 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created volume successfully. Jul 03 16:28:48 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645 1073741824" returned: 0 in 1.352s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:48 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645 Jul 03 16:28:48 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:49 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645" returned: 0 in 0.836s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:28:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75447b9-d8d5-4253-82b6-498538bb75ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020a210a-50c9-4c44-b452-13b606be2645', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e510ce5b-6b5b-43d1-9a63-ade74c410740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:28:49 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Volume volume-020a210a-50c9-4c44-b452-13b606be2645 (020a210a-50c9-4c44-b452-13b606be2645): created successfully Jul 03 16:28:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e510ce5b-6b5b-43d1-9a63-ade74c410740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:28:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Flow 'volume_create_manager' (e40dabfc-9479-47af-a051-0cb352b4122d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:28:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d713f830-718e-466e-a3e6-9beeedfa200e tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created volume successfully. Jul 03 16:28:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-020a210a-50c9-4c44-b452-13b606be2645-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-020a210a-50c9-4c44-b452-13b606be2645-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-quobyte-020a210a-50c9-4c44-b452-13b606be2645" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-020a210a-50c9-4c44-b452-13b606be2645" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:51 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[346d2243-e1c2-4125-a072-02865cd9d39c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:51 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645 Jul 03 16:28:51 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:51 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645" returned: 0 in 0.960s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:52 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645 Jul 03 16:28:52 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:52 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-020a210a-50c9-4c44-b452-13b606be2645" returned: 0 in 0.878s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-020a210a-50c9-4c44-b452-13b606be2645" released by "delete_volume" :: held 1.893s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:52 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created reservations ['3fa57d68-bf53-4a16-8b02-bfae2e9c1877', 'c73c35ed-98c4-4ee9-85ab-2947884bda17', '73e87ca0-959f-475b-b417-45937ffc14ce', '92636017-3592-4604-80ea-7a5b7a41a52d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:53 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:28:53 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-04c670f6-2888-4d79-98bf-c49f9329ef40-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-04c670f6-2888-4d79-98bf-c49f9329ef40-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-quobyte-04c670f6-2888-4d79-98bf-c49f9329ef40" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-04c670f6-2888-4d79-98bf-c49f9329ef40" acquired by "delete_volume" :: waited 0.015s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c693d52-98aa-4514-b810-75b88265ea4d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:53 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40 Jul 03 16:28:53 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:53 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.788s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:28:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Deleted volume successfully. Jul 03 16:28:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-00e8b4c1-8983-4e78-a268-807917c6ffbc tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-020a210a-50c9-4c44-b452-13b606be2645-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:54 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40" returned: 0 in 0.866s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:54 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40 Jul 03 16:28:54 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:55 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-04c670f6-2888-4d79-98bf-c49f9329ef40" returned: 0 in 1.121s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-04c670f6-2888-4d79-98bf-c49f9329ef40" released by "delete_volume" :: held 2.070s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created reservations ['3d2f9a12-e4cf-4d59-b046-da910f768b58', 'f2f367fc-f8a0-4a69-8af9-59ea72e69a9c', '6960979b-e1fc-47c5-8c82-c0dcb9121c55', '2327dbde-66aa-4447-9df8-79ef0c551cd2'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:55 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:28:55 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-3b6a3966-65b3-4b78-8b73-fca5d670e72d-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-3b6a3966-65b3-4b78-8b73-fca5d670e72d-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-quobyte-3b6a3966-65b3-4b78-8b73-fca5d670e72d" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-3b6a3966-65b3-4b78-8b73-fca5d670e72d" acquired by "delete_volume" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:56 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cabf8f-756c-44f6-8f0a-b2a8fb933d35]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:56 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d Jul 03 16:28:56 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-e46cfe89-41b5-46d0-950b-64c383acfb53 req-9dd55945-88c2-47aa-b17d-903843a31648 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-e46cfe89-41b5-46d0-950b-64c383acfb53 req-9dd55945-88c2-47aa-b17d-903843a31648 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:56 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c901df1-0374-4076-ba0c-2c6aa8c49637]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-e46cfe89-41b5-46d0-950b-64c383acfb53 req-9dd55945-88c2-47aa-b17d-903843a31648 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:56 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 Jul 03 16:28:56 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:57 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.434s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:57 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:28:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Deleted volume successfully. Jul 03 16:28:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-143a5575-77e5-4370-b516-65bd1d334101 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-04c670f6-2888-4d79-98bf-c49f9329ef40-delete_volume" released by "delete_volume" :: held 3.889s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:57 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d" returned: 0 in 1.217s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:57 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d Jul 03 16:28:57 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:57 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-e46cfe89-41b5-46d0-950b-64c383acfb53 req-9dd55945-88c2-47aa-b17d-903843a31648 tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25" returned: 0 in 1.216s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-e46cfe89-41b5-46d0-950b-64c383acfb53 req-9dd55945-88c2-47aa-b17d-903843a31648 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.255s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-e46cfe89-41b5-46d0-950b-64c383acfb53 req-9dd55945-88c2-47aa-b17d-903843a31648 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-6ac8f0fa-2665-4003-ba58-96d71f329b25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64f01b9e-9531-4c65-be1d-be25a123a7eb', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:28:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-e46cfe89-41b5-46d0-950b-64c383acfb53 req-9dd55945-88c2-47aa-b17d-903843a31648 tempest-TestServerVolumeAttachmentScenario-1272926891 None] attachment_update completed successfully. Jul 03 16:28:58 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jul 03 16:28:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b6a3966-65b3-4b78-8b73-fca5d670e72d" returned: 0 in 0.990s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:28:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-3b6a3966-65b3-4b78-8b73-fca5d670e72d" released by "delete_volume" :: held 2.292s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:28:58 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created reservations ['fb5e335f-f65b-4f97-b43f-64729f0fa220', 'c6d1ab33-3057-43cf-a0e4-a991ca661640', '4b276be5-1c80-47a8-b2ae-dc3d8eba6491', '7cbf094e-da63-4468-a670-fd6cc25a1d59'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:28:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:28:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:28:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:28:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:28:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:28:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:28:58 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:28:58 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:28:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-c8588210-04cb-4317-90fc-02995e34bf2f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-c8588210-04cb-4317-90fc-02995e34bf2f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-quobyte-c8588210-04cb-4317-90fc-02995e34bf2f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:28:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-c8588210-04cb-4317-90fc-02995e34bf2f" acquired by "delete_volume" :: waited 0.041s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:28:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c789d4e-361b-4ce7-9e30-42f6091c47ab]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:28:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:00 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f Jul 03 16:29:00 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:00 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.728s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:00 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:00 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Deleted volume successfully. Jul 03 16:29:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-898819e1-03a3-4626-981f-53e18044abfb tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-3b6a3966-65b3-4b78-8b73-fca5d670e72d-delete_volume" released by "delete_volume" :: held 4.442s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:01 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f" returned: 0 in 1.582s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:01 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f Jul 03 16:29:01 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:02 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c8588210-04cb-4317-90fc-02995e34bf2f" returned: 0 in 1.225s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-c8588210-04cb-4317-90fc-02995e34bf2f" released by "delete_volume" :: held 2.913s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:02 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created reservations ['8fda8bd7-21a8-4666-aacf-7a0f09814467', '54e12bc2-d359-400f-9ee1-be1d48831368', 'd78047d7-bb5e-4dac-8f89-0a95f6a7b4d9', '1f0a84db-3956-4e32-98ed-1c2bc1281c4e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:03 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:03 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-58ecf95c-6706-46e7-9a4c-d637e0bcb658-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-58ecf95c-6706-46e7-9a4c-d637e0bcb658-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-quobyte-58ecf95c-6706-46e7-9a4c-d637e0bcb658" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-58ecf95c-6706-46e7-9a4c-d637e0bcb658" acquired by "delete_volume" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdafb54-aa1d-4cc4-a3a7-9b95867326ab]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:03 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 Jul 03 16:29:03 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:03 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.967s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:03 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Deleted volume successfully. Jul 03 16:29:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8bca42c6-4c08-4d3c-8a65-90aa4a04f7c0 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-c8588210-04cb-4317-90fc-02995e34bf2f-delete_volume" released by "delete_volume" :: held 4.424s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:04 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-6f4b914c-1c71-43a1-8b66-eb6135b1f8cf req-3dfbb680-483d-4f97-81a4-8564facfc861 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Terminate volume connection completed successfully. Jul 03 16:29:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-6f4b914c-1c71-43a1-8b66-eb6135b1f8cf req-3dfbb680-483d-4f97-81a4-8564facfc861 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Deleting attachment 64f01b9e-9531-4c65-be1d-be25a123a7eb. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:29:04 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658" returned: 0 in 1.070s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:04 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658 Jul 03 16:29:04 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:05 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-58ecf95c-6706-46e7-9a4c-d637e0bcb658" returned: 0 in 0.692s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-58ecf95c-6706-46e7-9a4c-d637e0bcb658" released by "delete_volume" :: held 1.819s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created reservations ['0cf22a0c-02ac-48eb-9cb9-b30f0af75a65', '93d0b9f5-95f9-4df3-987d-bc316396fc23', '7659aa12-7155-4619-ba6d-8a6e16bda1dd', '5f34a62c-2175-41e4-8b67-f6747fe023d4'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:05 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:05 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-3c55c4f3-ddc8-47db-99f9-6fe13f09e448-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-3c55c4f3-ddc8-47db-99f9-6fe13f09e448-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-quobyte-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-quobyte-3c55c4f3-ddc8-47db-99f9-6fe13f09e448" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-3c55c4f3-ddc8-47db-99f9-6fe13f09e448" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Deleting offline snapshot 3c55c4f3-ddc8-47db-99f9-6fe13f09e448 of volume b87b56ac-fcd4-4f43-b6d6-05667d2201b9 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] snapshot_file for this snap is: volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbdae1c-9fc4-41ef-b0e6-70b30ea7669a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:06 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 Jul 03 16:29:06 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:06 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.890s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:06 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:06 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Deleted volume successfully. Jul 03 16:29:06 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=68,cinder:INSERT=20,cinder:UPDATE=91,cinder:DELETE=9 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:29:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-56c85106-cb83-428f-829c-3f2455c2491c tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-58ecf95c-6706-46e7-9a4c-d637e0bcb658-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:06 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448" returned: 0 in 1.121s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:29:07 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe68abc0-d1b3-43a8-aad4-03974d6fac40]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:07 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 Jul 03 16:29:07 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:07 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" returned: 0 in 0.900s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:07 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 Jul 03 16:29:07 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:08 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=80,cinder:INSERT=18,cinder:UPDATE=86,cinder:DELETE=8 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:29:08 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-a9413733-0b1e-441b-9eb4-2f52cdc7d98d req-a20cee8e-fcd7-4e25-8248-1035d17710cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Terminate volume connection completed successfully. Jul 03 16:29:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-a9413733-0b1e-441b-9eb4-2f52cdc7d98d req-a20cee8e-fcd7-4e25-8248-1035d17710cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Deleting attachment b7a12fd0-6571-4b8f-933b-e2ed46c4e952. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:29:08 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448" returned: 0 in 0.921s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:08 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448 Jul 03 16:29:08 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:09 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9.3c55c4f3-ddc8-47db-99f9-6fe13f09e448" returned: 0 in 0.815s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-3c55c4f3-ddc8-47db-99f9-6fe13f09e448" released by "_delete_snapshot" :: held 3.939s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" released by "delete_snapshot" :: held 3.990s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:09 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created reservations ['c4c7fe1d-afe6-4a42-81af-c8d4d43ad4c7', 'cce29a53-2343-484a-8529-51ba742e059d', '27118317-dafa-4c50-811a-645b76bd2067', 'a0b3a9eb-70ba-44b3-8270-b4f61f64e581'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:09 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Delete snapshot completed successfully. Jul 03 16:29:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c294634-fea7-43b5-999a-3fbf6fb04580 tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-3c55c4f3-ddc8-47db-99f9-6fe13f09e448-delete_snapshot" released by "delete_snapshot" :: held 4.178s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-b87b56ac-fcd4-4f43-b6d6-05667d2201b9-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-b87b56ac-fcd4-4f43-b6d6-05667d2201b9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "cinder-quobyte-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" acquired by "delete_volume" :: waited 0.030s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:10 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[499d6d9d-bd5d-4d88-a826-2dde567f0f3d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:10 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 Jul 03 16:29:10 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:11 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" returned: 0 in 1.123s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:11 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9 Jul 03 16:29:11 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:12 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" returned: 0 in 1.303s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-quobyte-b87b56ac-fcd4-4f43-b6d6-05667d2201b9" released by "delete_volume" :: held 2.528s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:12 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Created reservations ['5e7d1d63-f33a-4d19-b4b4-7d5e18fbfd36', '5b8b72a7-fb80-4060-a425-653106af145f', '15b64cbc-fd14-42b3-9c75-64730037f844', 'ecc09f62-4c2a-44ee-b3f2-e7efd0258f1e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:13 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:13 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:14 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.986s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:14 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Deleted volume successfully. Jul 03 16:29:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aaf7bb2d-302b-42fe-a588-b1363e05920a tempest-CreateVolumesFromSnapshotTest-1030987181 None] Lock "cinder-b87b56ac-fcd4-4f43-b6d6-05667d2201b9-delete_volume" released by "delete_volume" :: held 3.986s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Acquiring lock "cinder-802e8e25-6910-4de0-be24-30d7804b879c-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Lock "cinder-802e8e25-6910-4de0-be24-30d7804b879c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Acquiring lock "cinder-quobyte-802e8e25-6910-4de0-be24-30d7804b879c" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Lock "cinder-quobyte-802e8e25-6910-4de0-be24-30d7804b879c" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:14 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a5fd8f-df83-49bc-8579-b69e0aa9805d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:14 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c Jul 03 16:29:14 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:15 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c" returned: 0 in 1.132s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:15 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c Jul 03 16:29:15 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:16 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-802e8e25-6910-4de0-be24-30d7804b879c" returned: 0 in 0.751s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Lock "cinder-quobyte-802e8e25-6910-4de0-be24-30d7804b879c" released by "delete_volume" :: held 1.946s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:16 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Created reservations ['9e6d75fe-dc6e-4ed2-b09a-dca12e526e3f', 'aa3175a3-555a-49c3-893a-939dd6476c49', 'd5db362b-4cb0-4508-b927-04048e4702f7', 'b9d3ece6-9b15-4524-a245-2e6e1fcf2b70'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:16 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:16 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:17 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.736s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:17 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:17 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Deleted volume successfully. Jul 03 16:29:17 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-55bfa659-9357-4532-ab47-b1fc1f315fcb tempest-VolumesNegativeTest-1383067781 None] Lock "cinder-802e8e25-6910-4de0-be24-30d7804b879c-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Flow 'volume_create_manager' (71b71a2f-5435-4b23-b7ca-c183bc190098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1a4b17-c42e-421a-b9e8-b4f7934ca970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1a4b17-c42e-421a-b9e8-b4f7934ca970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437273722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50e8bea-06e2-41b2-8a5d-43fd86f33c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48437ef18e9a415e8e543ede10a9ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:19Z,use_quota=True,user_id='b37ef592ecfb4edb8ecff8e8fff32233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a08b59f-22e3-4e56-af6c-29dff2e7f5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a08b59f-22e3-4e56-af6c-29dff2e7f5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e7b03f-2b91-4347-b41e-97dae49d2367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e7b03f-2b91-4347-b41e-97dae49d2367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50e8bea-06e2-41b2-8a5d-43fd86f33c49', 'volume_name': 'volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15653676-9c64-4fb0-be9c-28ee1e75ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15653676-9c64-4fb0-be9c-28ee1e75ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1798d7f3-0a68-435f-b41e-a2f118673013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Volume a50e8bea-06e2-41b2-8a5d-43fd86f33c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49', 'volume_size': 1} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437273722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50e8bea-06e2-41b2-8a5d-43fd86f33c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48437ef18e9a415e8e543ede10a9ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:19Z,use_quota=True,user_id='b37ef592ecfb4edb8ecff8e8fff32233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Creating volume a50e8bea-06e2-41b2-8a5d-43fd86f33c49 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:29:18 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:18 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 1073741824 Jul 03 16:29:18 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:19 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:19 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:19 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.878s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:29:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:29:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:29:20 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 1073741824" returned: 0 in 1.281s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "cinder-6ac8f0fa-2665-4003-ba58-96d71f329b25-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "cinder-6ac8f0fa-2665-4003-ba58-96d71f329b25-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:20 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 Jul 03 16:29:20 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "cinder-quobyte-6ac8f0fa-2665-4003-ba58-96d71f329b25" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "cinder-quobyte-6ac8f0fa-2665-4003-ba58-96d71f329b25" acquired by "delete_volume" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:20 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1723f81-70d1-4793-b0ff-f86bd277bc26]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:20 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 Jul 03 16:29:20 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:21 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49" returned: 0 in 0.846s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:29:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1798d7f3-0a68-435f-b41e-a2f118673013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a561fa-23a6-4508-a7bc-6b1e4548f9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:21 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Volume volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 (a50e8bea-06e2-41b2-8a5d-43fd86f33c49): created successfully Jul 03 16:29:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a561fa-23a6-4508-a7bc-6b1e4548f9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Flow 'volume_create_manager' (71b71a2f-5435-4b23-b7ca-c183bc190098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7855ffb2-a012-4047-a3c6-4c20cd710f78 tempest-ProjectReaderTests-1008712350 None] Created volume successfully. Jul 03 16:29:21 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25" returned: 0 in 1.065s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:21 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25 Jul 03 16:29:21 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:22 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6ac8f0fa-2665-4003-ba58-96d71f329b25" returned: 0 in 1.073s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "cinder-quobyte-6ac8f0fa-2665-4003-ba58-96d71f329b25" released by "delete_volume" :: held 2.213s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Acquiring lock "cinder-a50e8bea-06e2-41b2-8a5d-43fd86f33c49-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Lock "cinder-a50e8bea-06e2-41b2-8a5d-43fd86f33c49-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Created reservations ['ca5a3b7c-254b-4963-8e4a-850175195dd1', '55ae5da4-bfe1-45da-9701-142a4b7fb4c2', '96dd668a-f674-41a5-a9ce-7b7d7cc5299e', '49d2e135-249a-4b76-b81b-0e9b552754f1'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Acquiring lock "cinder-quobyte-a50e8bea-06e2-41b2-8a5d-43fd86f33c49" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Lock "cinder-quobyte-a50e8bea-06e2-41b2-8a5d-43fd86f33c49" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[28637be3-ee58-462f-b2ea-573f62421d0c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:22 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:22 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:22 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 Jul 03 16:29:22 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "cinder-1c326b0b-5e89-4059-b07e-c68b67f5b175-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "cinder-1c326b0b-5e89-4059-b07e-c68b67f5b175-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "cinder-quobyte-1c326b0b-5e89-4059-b07e-c68b67f5b175" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "cinder-quobyte-1c326b0b-5e89-4059-b07e-c68b67f5b175" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:23 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d647736-769a-4a75-957c-fe45da7b2e38]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:23 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49" returned: 0 in 1.155s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:24 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.120s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:24 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Deleted volume successfully. Jul 03 16:29:24 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49 Jul 03 16:29:24 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e44bc760-4f28-422a-a56c-434378e1c2cc tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "cinder-6ac8f0fa-2665-4003-ba58-96d71f329b25-delete_volume" released by "delete_volume" :: held 3.768s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:24 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 Jul 03 16:29:24 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:24 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a50e8bea-06e2-41b2-8a5d-43fd86f33c49" returned: 0 in 0.788s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Lock "cinder-quobyte-a50e8bea-06e2-41b2-8a5d-43fd86f33c49" released by "delete_volume" :: held 2.010s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Created reservations ['63c0db60-711f-4a79-b119-ebc2e8b3b054', 'ea3752c1-ea35-40e7-9d35-610adc223281', 'ddb3dbd5-50df-4c07-9961-eeebdba7dd0f', 'e518ac7d-9108-4b23-b2ef-d19c58d5053f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:24 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175" returned: 0 in 0.948s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:24 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175 Jul 03 16:29:24 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:25 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:25 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Flow 'volume_create_manager' (372367f5-6e57-41b1-ac5a-a753fae71777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:25 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b9a631-50d4-4554-82cc-5b9124a10abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1c326b0b-5e89-4059-b07e-c68b67f5b175" returned: 0 in 0.998s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "cinder-quobyte-1c326b0b-5e89-4059-b07e-c68b67f5b175" released by "delete_volume" :: held 2.012s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b9a631-50d4-4554-82cc-5b9124a10abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-498541665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55773ae-da2f-422d-8676-e5591fd1b0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48437ef18e9a415e8e543ede10a9ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:26Z,use_quota=True,user_id='b37ef592ecfb4edb8ecff8e8fff32233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3fe837-fc2c-4a2b-b984-f535db339141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3fe837-fc2c-4a2b-b984-f535db339141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89228547-c1d6-4b52-baab-0a313f4de301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89228547-c1d6-4b52-baab-0a313f4de301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55773ae-da2f-422d-8676-e5591fd1b0c5', 'volume_name': 'volume-f55773ae-da2f-422d-8676-e5591fd1b0c5', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6636ad-0639-46dd-aa68-e338f1dd5b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6636ad-0639-46dd-aa68-e338f1dd5b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e8845c-247f-43d1-acfb-e9d531740371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Volume f55773ae-da2f-422d-8676-e5591fd1b0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55773ae-da2f-422d-8676-e5591fd1b0c5', 'volume_size': 1} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-498541665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55773ae-da2f-422d-8676-e5591fd1b0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48437ef18e9a415e8e543ede10a9ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:26Z,use_quota=True,user_id='b37ef592ecfb4edb8ecff8e8fff32233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Creating volume f55773ae-da2f-422d-8676-e5591fd1b0c5 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:29:26 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:26 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.033s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:26 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 1073741824 Jul 03 16:29:26 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:26 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Deleted volume successfully. Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bcddbfc7-454c-4d19-93e6-d88ee770a649 tempest-ProjectReaderTests-1008712350 None] Lock "cinder-a50e8bea-06e2-41b2-8a5d-43fd86f33c49-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Created reservations ['950ebfc2-0127-490c-b877-5f70819e764b', 'dbdacb82-e33e-4c14-9d88-0d19c9c95e2f', 'a1ea0e4c-5e68-4ebf-a05c-97b3a0cbdbfa', '9bc7fdb0-4f63-4b3a-ab45-31f70b6c5aa5'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:26 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:26 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:27 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.152s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:27 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:27 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Deleted volume successfully. Jul 03 16:29:27 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e6f4a6c1-af39-42c2-96ae-e624ac5436f3 tempest-TestServerVolumeAttachmentScenario-1272926891 None] Lock "cinder-1c326b0b-5e89-4059-b07e-c68b67f5b175-delete_volume" released by "delete_volume" :: held 3.717s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:27 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 1073741824" returned: 0 in 1.517s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:27 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 Jul 03 16:29:27 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:28 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5" returned: 0 in 1.024s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] <== create_volume: return (2612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:29:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.616s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e8845c-247f-43d1-acfb-e9d531740371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55773ae-da2f-422d-8676-e5591fd1b0c5', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62690968-ec32-4693-b4d1-e81ce8900fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:28 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Volume volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 (f55773ae-da2f-422d-8676-e5591fd1b0c5): created successfully Jul 03 16:29:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62690968-ec32-4693-b4d1-e81ce8900fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Flow 'volume_create_manager' (372367f5-6e57-41b1-ac5a-a753fae71777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-648381d8-ff6d-41c3-a1d9-466d772d7c1c tempest-ProjectReaderTests-1008712350 None] Created volume successfully. Jul 03 16:29:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Acquiring lock "cinder-f55773ae-da2f-422d-8676-e5591fd1b0c5-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Lock "cinder-f55773ae-da2f-422d-8676-e5591fd1b0c5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Acquiring lock "cinder-quobyte-f55773ae-da2f-422d-8676-e5591fd1b0c5" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Lock "cinder-quobyte-f55773ae-da2f-422d-8676-e5591fd1b0c5" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:29 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaa3431-0d53-4f46-9591-b86e5c78b083]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:29 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 Jul 03 16:29:29 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:30 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5" returned: 0 in 1.480s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:30 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5 Jul 03 16:29:30 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:31 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-f55773ae-da2f-422d-8676-e5591fd1b0c5" returned: 0 in 1.047s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Lock "cinder-quobyte-f55773ae-da2f-422d-8676-e5591fd1b0c5" released by "delete_volume" :: held 2.593s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:31 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Created reservations ['9f95c21c-bd39-4084-8f2a-782db46abd8c', '95a19956-a64f-402c-baa5-94b3d8df456a', '5fc6674a-896c-4eea-9f02-daf8dab60ce6', '75fcc3c9-5e9c-4cc4-ad50-a7eb42bc0dbd'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:32 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:32 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:33 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.211s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:33 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Deleted volume successfully. Jul 03 16:29:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d1a54037-5c98-4afb-a3cc-38f8d7153fb6 tempest-ProjectReaderTests-1008712350 None] Lock "cinder-f55773ae-da2f-422d-8676-e5591fd1b0c5-delete_volume" released by "delete_volume" :: held 4.154s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-927b7c69-ce10-4ba5-86fc-ee047792d90b req-d84cc00e-2902-41e8-a4ea-1dc2622982dc tempest-TestMinimumBasicScenario-2080705228 None] Terminate volume connection completed successfully. Jul 03 16:29:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-927b7c69-ce10-4ba5-86fc-ee047792d90b req-d84cc00e-2902-41e8-a4ea-1dc2622982dc tempest-TestMinimumBasicScenario-2080705228 None] Deleting attachment 63181a1b-5a3c-41aa-8090-f9a6e45ab50b. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:29:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Acquiring lock "cinder-49dbf0ea-a0c2-4c7f-8793-719a89373fac-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Lock "cinder-49dbf0ea-a0c2-4c7f-8793-719a89373fac-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Acquiring lock "cinder-quobyte-49dbf0ea-a0c2-4c7f-8793-719a89373fac" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Lock "cinder-quobyte-49dbf0ea-a0c2-4c7f-8793-719a89373fac" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:36 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ac5b47-b97d-4980-951e-93cb26257946]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:36 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac Jul 03 16:29:36 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:37 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac" returned: 0 in 1.275s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:38 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac Jul 03 16:29:38 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (4500b618-820b-4117-8ba6-9ee97c3fdde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57065812-0c1a-44cc-88da-a74988f13b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57065812-0c1a-44cc-88da-a74988f13b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1455183383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c1f76f-8ea2-4295-ac51-b45bfc938bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cfdffe6adf470dad82d4ad77a660cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:38Z,use_quota=True,user_id='fb57c871fb334655bebeeafc1935fd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285e247a-9858-45a7-8577-9372f64a7c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285e247a-9858-45a7-8577-9372f64a7c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824dbaa9-71ff-47de-b468-89d5cc94ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824dbaa9-71ff-47de-b468-89d5cc94ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c1f76f-8ea2-4295-ac51-b45bfc938bb6', 'volume_name': 'volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23ea7e5-ca97-4d7f-99e3-5abf10c56c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23ea7e5-ca97-4d7f-99e3-5abf10c56c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd076a7e-870a-4017-ab24-e885ad59270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Volume 92c1f76f-8ea2-4295-ac51-b45bfc938bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6', 'volume_size': 1} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1455183383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c1f76f-8ea2-4295-ac51-b45bfc938bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cfdffe6adf470dad82d4ad77a660cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:38Z,use_quota=True,user_id='fb57c871fb334655bebeeafc1935fd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Creating volume 92c1f76f-8ea2-4295-ac51-b45bfc938bb6 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:29:38 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:29:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:38 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 1073741824 Jul 03 16:29:38 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:39 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-49dbf0ea-a0c2-4c7f-8793-719a89373fac" returned: 0 in 1.120s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Lock "cinder-quobyte-49dbf0ea-a0c2-4c7f-8793-719a89373fac" released by "delete_volume" :: held 2.470s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:39 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Created reservations ['045a9656-5906-4da1-8a25-aeeab1d01b40', '3db0108f-24f0-4303-89a7-da8c22cfeaf2', '25708fef-eea5-4132-a0fd-7e7ca63b44ea', '4ab268de-cb01-4918-8abd-429e0589ce05'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:39 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:29:39 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:40 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 1073741824" returned: 0 in 1.532s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:40 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 Jul 03 16:29:40 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:40 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.158s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:40 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:29:40 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Deleted volume successfully. Jul 03 16:29:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b2323b60-544c-4b8d-a12d-50ce58963524 tempest-TestMinimumBasicScenario-2080705228 None] Lock "cinder-49dbf0ea-a0c2-4c7f-8793-719a89373fac-delete_volume" released by "delete_volume" :: held 4.035s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:41 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" returned: 0 in 1.092s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] <== create_volume: return (2716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:29:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.720s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd076a7e-870a-4017-ab24-e885ad59270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef189f7-894c-48ec-8d19-7bc039ea32a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:41 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Volume volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 (92c1f76f-8ea2-4295-ac51-b45bfc938bb6): created successfully Jul 03 16:29:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef189f7-894c-48ec-8d19-7bc039ea32a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (4500b618-820b-4117-8ba6-9ee97c3fdde0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:41 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4f5ab856-af87-46d2-8aba-a5f87fe574aa tempest-VolumesSnapshotTestJSON-91942839 None] Created volume successfully. Jul 03 16:29:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Creating offline snapshot 92e97d56-edca-4f9c-8bbc-946c9e555196 of volume 92c1f76f-8ea2-4295-ac51-b45bfc938bb6 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:29:42 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb70e80-6ec5-4aee-adc0-9125695e4ac0]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:42 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 Jul 03 16:29:42 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:43 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" returned: 0 in 1.204s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:43 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 1G Jul 03 16:29:43 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:44 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 1G" returned: 0 in 1.454s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:45 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 Jul 03 16:29:45 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:46 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196" returned: 0 in 1.135s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:46 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 is being set with open permissions: ugo+rw Jul 03 16:29:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:46 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 Jul 03 16:29:46 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:47 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196" returned: 0 in 0.992s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:47 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.info Jul 03 16:29:47 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:48 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.info" returned: 0 in 1.035s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:48 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.info is being set with open permissions: ugo+rw Jul 03 16:29:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:48 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.info Jul 03 16:29:48 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:49 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.info" returned: 0 in 1.306s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.292s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-904c4ed0-e703-4f04-b268-b00f95bba9ba tempest-VolumesSnapshotTestJSON-91942839 None] Create snapshot completed successfully Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (6c6b851d-4d9e-4127-bbdc-ec5c76da73f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09dd5204-800b-4bbd-8b85-f1618f43f2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-92e97d56-edca-4f9c-8bbc-946c9e555196-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09dd5204-800b-4bbd-8b85-f1618f43f2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63985995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a61231-f930-4fae-815a-25a6aaa88001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:51Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6096383b-e941-4995-a5e6-fdc1657aadef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6096383b-e941-4995-a5e6-fdc1657aadef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfee692a-20d8-4fd1-b82a-622122210ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfee692a-20d8-4fd1-b82a-622122210ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a61231-f930-4fae-815a-25a6aaa88001', 'volume_name': 'volume-86a61231-f930-4fae-815a-25a6aaa88001', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fb8a59-e945-45fc-8eaf-178e4b2d7867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fb8a59-e945-45fc-8eaf-178e4b2d7867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d38858-2cd3-4af3-933b-1fdc72f2379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Volume 86a61231-f930-4fae-815a-25a6aaa88001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a61231-f930-4fae-815a-25a6aaa88001', 'volume_size': 1} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63985995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a61231-f930-4fae-815a-25a6aaa88001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:51Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Creating volume 86a61231-f930-4fae-815a-25a6aaa88001 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:29:51 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:51 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001 1073741824 Jul 03 16:29:51 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-92e97d56-edca-4f9c-8bbc-946c9e555196-delete_snapshot" acquired by "delete_snapshot" :: waited 0.177s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-92e97d56-edca-4f9c-8bbc-946c9e555196" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-92e97d56-edca-4f9c-8bbc-946c9e555196" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Deleting offline snapshot 92e97d56-edca-4f9c-8bbc-946c9e555196 of volume 92c1f76f-8ea2-4295-ac51-b45bfc938bb6 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] snapshot_file for this snap is: volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c312aa1-e601-4a52-b1d0-d755709a32f9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:51 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 Jul 03 16:29:51 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (baaf8799-395b-48fa-89dc-fad2e87e6394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af5107d-a0de-49e7-b102-b4d56978f1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af5107d-a0de-49e7-b102-b4d56978f1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506882661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4372cd33-73ae-4834-9c1d-668ad8c71059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:52Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03e2b19-0a0d-4f4a-acda-bd4da3217e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03e2b19-0a0d-4f4a-acda-bd4da3217e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35434bf-fcf6-4843-b5fe-771b2c4daccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35434bf-fcf6-4843-b5fe-771b2c4daccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4372cd33-73ae-4834-9c1d-668ad8c71059', 'volume_name': 'volume-4372cd33-73ae-4834-9c1d-668ad8c71059', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d1fe3c-33dc-4bd9-974c-96cd598189ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d1fe3c-33dc-4bd9-974c-96cd598189ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666be0bf-642d-4447-84a0-5f2c7305cf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Volume 4372cd33-73ae-4834-9c1d-668ad8c71059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4372cd33-73ae-4834-9c1d-668ad8c71059', 'volume_size': 1} Jul 03 16:29:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:29:52 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (bd3e9b90-eeba-4e1b-abda-623b26b678b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f36844-b97c-4ab6-af86-2fe533d13606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001 1073741824" returned: 0 in 1.331s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f36844-b97c-4ab6-af86-2fe533d13606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1776574611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c363e748-6a56-4c3d-a8bb-3b138b869708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:52Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa55369d-8f42-40a7-aa86-0f142ce0a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa55369d-8f42-40a7-aa86-0f142ce0a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54733ff-9389-4d3a-933f-f2622c84763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54733ff-9389-4d3a-933f-f2622c84763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c363e748-6a56-4c3d-a8bb-3b138b869708', 'volume_name': 'volume-c363e748-6a56-4c3d-a8bb-3b138b869708', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7884bc-d8d0-4de6-9fcf-0294fc32eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7884bc-d8d0-4de6-9fcf-0294fc32eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f0cd64-e6a1-4c3a-b098-e950566347a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:52 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Volume c363e748-6a56-4c3d-a8bb-3b138b869708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c363e748-6a56-4c3d-a8bb-3b138b869708', 'volume_size': 1} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:52 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001 Jul 03 16:29:52 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:52 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196" returned: 0 in 1.265s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff93eefa-424e-4c58-8443-4a41163ad316]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:29:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:52 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 Jul 03 16:29:52 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (4cc4b406-0c25-4251-8409-ecf62e4b39e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bb8315-a759-4a97-a42f-fa4a46d040e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bb8315-a759-4a97-a42f-fa4a46d040e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055409729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:53Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ce0846-b0a6-4af5-b0fa-7388e6d0f78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ce0846-b0a6-4af5-b0fa-7388e6d0f78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5dbca8-a665-46fe-896b-eedd8acd221b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5dbca8-a665-46fe-896b-eedd8acd221b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886', 'volume_name': 'volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b10fb07-daec-42da-94dd-c7cba550d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b10fb07-daec-42da-94dd-c7cba550d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce7b4c9-add8-4182-9b3b-9b1fc35137f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:53 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Volume 65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886', 'volume_size': 1} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:53 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001" returned: 0 in 1.089s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] <== create_volume: return (2559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.570s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.811s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506882661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4372cd33-73ae-4834-9c1d-668ad8c71059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:52Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Creating volume 4372cd33-73ae-4834-9c1d-668ad8c71059 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:29:53 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d38858-2cd3-4af3-933b-1fdc72f2379c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a61231-f930-4fae-815a-25a6aaa88001', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:53 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059 1073741824 Jul 03 16:29:53 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62917ea9-5367-4321-be6f-3abfbd87a791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:53 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Volume volume-86a61231-f930-4fae-815a-25a6aaa88001 (86a61231-f930-4fae-815a-25a6aaa88001): created successfully Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62917ea9-5367-4321-be6f-3abfbd87a791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (6c6b851d-4d9e-4127-bbdc-ec5c76da73f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d9fa1824-666c-48c5-a454-e3d356da0e80 tempest-CreateVolumesFromImageTest-1122688777 None] Created volume successfully. Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (460ba291-0e4d-4741-9136-02f42e1dfd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78edcde-5091-468c-8cb9-bb02c7a0fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78edcde-5091-468c-8cb9-bb02c7a0fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1827581952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5840b210-71f1-4fc7-9b29-2dec618db7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:54Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589b5bc3-54ec-4789-83df-08473bcf0989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589b5bc3-54ec-4789-83df-08473bcf0989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a569ed98-6ee5-4b4b-af25-ab4a56c3c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a569ed98-6ee5-4b4b-af25-ab4a56c3c957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5840b210-71f1-4fc7-9b29-2dec618db7e0', 'volume_name': 'volume-5840b210-71f1-4fc7-9b29-2dec618db7e0', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7b066a-337c-4186-9e1d-dd5eb7d12cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7b066a-337c-4186-9e1d-dd5eb7d12cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6821ffae-26c5-48a3-9660-785f33dc5bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:54 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Volume 5840b210-71f1-4fc7-9b29-2dec618db7e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5840b210-71f1-4fc7-9b29-2dec618db7e0', 'volume_size': 1} Jul 03 16:29:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:54 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" returned: 0 in 1.498s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:54 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 Jul 03 16:29:54 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:55 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059 1073741824" returned: 0 in 1.353s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:55 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059 Jul 03 16:29:55 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:55 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196" returned: 0 in 1.045s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:55 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196 Jul 03 16:29:55 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:56 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059" returned: 0 in 1.009s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.450s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.583s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1776574611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c363e748-6a56-4c3d-a8bb-3b138b869708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:52Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Creating volume c363e748-6a56-4c3d-a8bb-3b138b869708 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:56 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:29:56 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6.92e97d56-edca-4f9c-8bbc-946c9e555196" returned: 0 in 0.956s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:56 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708 1073741824 Jul 03 16:29:56 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666be0bf-642d-4447-84a0-5f2c7305cf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4372cd33-73ae-4834-9c1d-668ad8c71059', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963b0328-0a30-4b7b-b029-704604a1676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:56 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Volume volume-4372cd33-73ae-4834-9c1d-668ad8c71059 (4372cd33-73ae-4834-9c1d-668ad8c71059): created successfully Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963b0328-0a30-4b7b-b029-704604a1676b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (baaf8799-395b-48fa-89dc-fad2e87e6394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-92e97d56-edca-4f9c-8bbc-946c9e555196" released by "_delete_snapshot" :: held 4.986s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" released by "delete_snapshot" :: held 5.031s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:56 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-475f4f52-06c8-413c-9d52-da28c44f7766 tempest-CreateVolumesFromImageTest-1122688777 None] Created volume successfully. Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Created reservations ['05d2bf87-ac34-4c95-aef2-e09972f467bc', '2ba0fd94-f6e0-4a04-b516-1990593b071e', '9b105625-ece9-4425-b8ca-4cb88121aed2', '2636430f-0bab-4fcf-8e0b-cf7fd2378a0c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:29:56 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Delete snapshot completed successfully. Jul 03 16:29:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-05c5a928-2594-480f-af3e-ac5de06a41a8 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-92e97d56-edca-4f9c-8bbc-946c9e555196-delete_snapshot" released by "delete_snapshot" :: held 5.349s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:29:57 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708 1073741824" returned: 0 in 1.287s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:57 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708 Jul 03 16:29:57 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:58 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708" returned: 0 in 0.997s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.293s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055409729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:53Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Creating volume 65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:29:58 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:58 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 1073741824 Jul 03 16:29:58 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f0cd64-e6a1-4c3a-b098-e950566347a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c363e748-6a56-4c3d-a8bb-3b138b869708', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd1cb86-676d-49fc-a8cc-9989bb84771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (19b2479b-3d28-41e4-bef6-fd7734fe3edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f328ec35-f487-4e86-8565-48cfa94fa0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:58 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Volume volume-c363e748-6a56-4c3d-a8bb-3b138b869708 (c363e748-6a56-4c3d-a8bb-3b138b869708): created successfully Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd1cb86-676d-49fc-a8cc-9989bb84771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (bd3e9b90-eeba-4e1b-abda-623b26b678b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f328ec35-f487-4e86-8565-48cfa94fa0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-414022928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e07b703-cc39-42f2-8d19-3fab025c287a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cfdffe6adf470dad82d4ad77a660cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:59Z,use_quota=True,user_id='fb57c871fb334655bebeeafc1935fd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01efafbf-db89-4a9f-a4d4-d6d906986c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01efafbf-db89-4a9f-a4d4-d6d906986c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fe82cd-5656-4c27-9b05-4cc1a5e58d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fe82cd-5656-4c27-9b05-4cc1a5e58d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e07b703-cc39-42f2-8d19-3fab025c287a', 'volume_name': 'volume-3e07b703-cc39-42f2-8d19-3fab025c287a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02915569-b548-4acc-9a80-db0285f929ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02915569-b548-4acc-9a80-db0285f929ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a58743-adb9-4830-b0a6-6fc9f9508b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:29:58 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Volume 3e07b703-cc39-42f2-8d19-3fab025c287a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e07b703-cc39-42f2-8d19-3fab025c287a', 'volume_size': 1} Jul 03 16:29:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:29:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-dbe85783-4c20-4890-abe8-a726afc7afbb tempest-CreateVolumesFromImageTest-1122688777 None] Created volume successfully. Jul 03 16:29:59 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jul 03 16:29:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 1073741824" returned: 0 in 1.256s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:29:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:29:59 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 Jul 03 16:29:59 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:00 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886" returned: 0 in 0.887s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.752s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1827581952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5840b210-71f1-4fc7-9b29-2dec618db7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78804f36cf24156b2672c59bda6d800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:54Z,use_quota=True,user_id='3b5a0598d9fc4ccf9c3ccf5085b15620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Creating volume 5840b210-71f1-4fc7-9b29-2dec618db7e0 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:30:00 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:00 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 1073741824 Jul 03 16:30:00 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce7b4c9-add8-4182-9b3b-9b1fc35137f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55304e2-0f5d-4c55-85ac-d3041c36d9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:00 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Volume volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 (65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886): created successfully Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55304e2-0f5d-4c55-85ac-d3041c36d9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (4cc4b406-0c25-4251-8409-ecf62e4b39e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:00 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1c3ad410-fca3-459f-9846-22b5a33e2d98 tempest-CreateVolumesFromImageTest-1122688777 None] Created volume successfully. Jul 03 16:30:02 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 1073741824" returned: 0 in 1.485s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:02 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 Jul 03 16:30:02 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:03 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0" returned: 0 in 0.903s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] <== create_volume: return (2459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.462s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.465s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-414022928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e07b703-cc39-42f2-8d19-3fab025c287a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cfdffe6adf470dad82d4ad77a660cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:29:59Z,use_quota=True,user_id='fb57c871fb334655bebeeafc1935fd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Creating volume 3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:30:03 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:03 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a 1073741824 Jul 03 16:30:03 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6821ffae-26c5-48a3-9660-785f33dc5bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5840b210-71f1-4fc7-9b29-2dec618db7e0', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abf458a-e89e-49e3-9e0e-1121aedf81db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:03 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Volume volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 (5840b210-71f1-4fc7-9b29-2dec618db7e0): created successfully Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abf458a-e89e-49e3-9e0e-1121aedf81db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Flow 'volume_create_manager' (460ba291-0e4d-4741-9136-02f42e1dfd5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-65bc8179-75eb-41e3-9252-69a77a13506d tempest-CreateVolumesFromImageTest-1122688777 None] Created volume successfully. Jul 03 16:30:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-5840b210-71f1-4fc7-9b29-2dec618db7e0-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-5840b210-71f1-4fc7-9b29-2dec618db7e0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-quobyte-5840b210-71f1-4fc7-9b29-2dec618db7e0" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-5840b210-71f1-4fc7-9b29-2dec618db7e0" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:04 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a992b50e-3101-4de3-97d0-2bb450074dd2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:04 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 Jul 03 16:30:04 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:04 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a 1073741824" returned: 0 in 1.547s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:04 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a Jul 03 16:30:04 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:05 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0" returned: 0 in 1.321s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:05 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0 Jul 03 16:30:05 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:05 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a" returned: 0 in 1.108s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] <== create_volume: return (2753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:30:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.756s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a58743-adb9-4830-b0a6-6fc9f9508b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e07b703-cc39-42f2-8d19-3fab025c287a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8dfbfa3-5601-4330-9d1c-c5f44e6ff3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:06 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Volume volume-3e07b703-cc39-42f2-8d19-3fab025c287a (3e07b703-cc39-42f2-8d19-3fab025c287a): created successfully Jul 03 16:30:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8dfbfa3-5601-4330-9d1c-c5f44e6ff3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (19b2479b-3d28-41e4-bef6-fd7734fe3edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:06 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7d430dab-1aa7-4934-9195-324d87f3b98d tempest-VolumesSnapshotTestJSON-91942839 None] Created volume successfully. Jul 03 16:30:06 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=74,cinder:INSERT=23,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:30:06 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5840b210-71f1-4fc7-9b29-2dec618db7e0" returned: 0 in 1.058s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-5840b210-71f1-4fc7-9b29-2dec618db7e0" released by "delete_volume" :: held 2.441s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Creating offline snapshot 0934c72b-53f7-4370-a3a6-d1c915b511e0 of volume 3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:30:07 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1befc98b-84a8-4f0f-8b08-17247c07c5b6]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:07 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a Jul 03 16:30:07 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:08 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Created reservations ['d4ebdf27-7f15-459e-a5cf-44579dc6a3e4', '1e2f9aee-56e0-49d7-b712-cf0338abaf33', '7115c4f4-1dcd-434c-8fe4-b859966f7811', '357e8e0f-b0b8-4fef-a3b1-3a30fabc262a'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:30:08 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a" returned: 0 in 0.897s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:08 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 1G Jul 03 16:30:08 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:09 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=87,cinder:INSERT=27,cinder:UPDATE=104,cinder:DELETE=9 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:30:09 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 1G" returned: 0 in 1.019s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e07b703-cc39-42f2-8d19-3fab025c287a -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:09 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e07b703-cc39-42f2-8d19-3fab025c287a -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 Jul 03 16:30:09 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:10 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e07b703-cc39-42f2-8d19-3fab025c287a -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0" returned: 0 in 0.773s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:10 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 is being set with open permissions: ugo+rw Jul 03 16:30:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:10 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 Jul 03 16:30:10 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:10 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0" returned: 0 in 0.721s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:11 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:30:11 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:12 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.787s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:30:12 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.info Jul 03 16:30:12 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Deleted volume successfully. Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-746dd440-de6a-4a01-aabe-272f17c7c459 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-5840b210-71f1-4fc7-9b29-2dec618db7e0-delete_volume" released by "delete_volume" :: held 8.363s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-quobyte-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb1e0a0-37bf-416b-adb8-8f9e6333ea23]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:13 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 Jul 03 16:30:13 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:13 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.info" returned: 0 in 1.071s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:13 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.info is being set with open permissions: ugo+rw Jul 03 16:30:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:13 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.info Jul 03 16:30:13 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:14 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886" returned: 0 in 1.238s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:14 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886 Jul 03 16:30:14 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:14 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.info" returned: 0 in 0.973s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.131s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-eac38dfa-6d7e-43fa-b9a6-bd87dca16bad tempest-VolumesSnapshotTestJSON-91942839 None] Create snapshot completed successfully Jul 03 16:30:15 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886" returned: 0 in 1.027s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886" released by "delete_volume" :: held 2.333s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:15 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Created reservations ['b8f1c98b-f90a-48c9-b401-39fb948cefba', '0426c1be-d3ea-4d78-88eb-3f4d0e112cd7', 'ed0ee5c3-b663-4073-b4d2-d4be5a41edca', '8974f6de-a5d2-4fa6-a266-5e78dea70178'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:30:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:15 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:30:15 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-c363e748-6a56-4c3d-a8bb-3b138b869708-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-c363e748-6a56-4c3d-a8bb-3b138b869708-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:30:16 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.079s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:30:16 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Deleted volume successfully. Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-quobyte-c363e748-6a56-4c3d-a8bb-3b138b869708" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (981fd4ea-ce73-48a9-8f82-015f1d710ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c2a3ef-750e-4f7c-90c3-9b8cb81cc20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c2a3ef-750e-4f7c-90c3-9b8cb81cc20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-357403010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e837ad-5a45-47cd-a0f8-a5f5358e34d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cfdffe6adf470dad82d4ad77a660cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0934c72b-53f7-4370-a3a6-d1c915b511e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:16Z,use_quota=True,user_id='fb57c871fb334655bebeeafc1935fd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaf0624-b301-49ae-a3ac-2600e6891ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaf0624-b301-49ae-a3ac-2600e6891ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfadddb6-b7ce-49c7-b1f3-5aab39deffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfadddb6-b7ce-49c7-b1f3-5aab39deffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6e837ad-5a45-47cd-a0f8-a5f5358e34d3', 'volume_name': 'volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3', 'volume_size': 2, 'snapshot_id': '0934c72b-53f7-4370-a3a6-d1c915b511e0'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84253077-baa7-496e-8ac9-0b41fdc55ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84253077-baa7-496e-8ac9-0b41fdc55ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4f2e9-fdc3-474d-adf6-adf4483b079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:16 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Volume d6e837ad-5a45-47cd-a0f8-a5f5358e34d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3', 'volume_size': 2, 'snapshot_id': '0934c72b-53f7-4370-a3a6-d1c915b511e0'} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-c363e748-6a56-4c3d-a8bb-3b138b869708" acquired by "delete_volume" :: waited 0.100s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-559fbdba-737b-4c4a-8bc5-246438137122 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-65aeb0f6-c8d3-4b58-ae54-f15cbaeb3886-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-0934c72b-53f7-4370-a3a6-d1c915b511e0-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" by "_create_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c107136-5def-4187-8cc0-723f056ca428]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-0934c72b-53f7-4370-a3a6-d1c915b511e0-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Creating volume d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 from snapshot 0934c72b-53f7-4370-a3a6-d1c915b511e0 {{(pid=86659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] snapshot: 0934c72b-53f7-4370-a3a6-d1c915b511e0, volume: d6e837ad-5a45-47cd-a0f8-a5f5358e34d3, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:30:16 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708 Jul 03 16:30:16 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d945fe3f-57ac-4621-975d-11b5a6d61400]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:17 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 Jul 03 16:30:17 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:17 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708" returned: 0 in 1.245s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:17 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708 Jul 03 16:30:17 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:17 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0" returned: 0 in 1.217s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e07b703-cc39-42f2-8d19-3fab025c287a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:30:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:30:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:30:17 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4a18f0-d073-48ee-988a-f4e027cec037]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:18 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a Jul 03 16:30:18 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:18 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c363e748-6a56-4c3d-a8bb-3b138b869708" returned: 0 in 1.016s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-c363e748-6a56-4c3d-a8bb-3b138b869708" released by "delete_volume" :: held 2.326s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Created reservations ['c1ef6628-98d1-458f-91c9-eb4a2096c148', '13f9ef08-20dc-408b-b372-74ae15a8cd2d', '9afdec6f-1fff-418c-8258-377ef23126b2', 'f11be70f-10c8-4c2b-a749-8560d361a7ca'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:19 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:30:19 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:19 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:30:19 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:19 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a" returned: 0 in 1.245s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:19 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 Jul 03 16:30:19 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-4372cd33-73ae-4834-9c1d-668ad8c71059-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-4372cd33-73ae-4834-9c1d-668ad8c71059-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-quobyte-4372cd33-73ae-4834-9c1d-668ad8c71059" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-4372cd33-73ae-4834-9c1d-668ad8c71059" acquired by "delete_volume" :: waited 0.046s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:20 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.053s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:30:20 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Deleted volume successfully. Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae38d3-7bd8-4f54-a90a-2efd2cbe2842]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27417404-cc68-4931-98ee-92cb395578e9 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-c363e748-6a56-4c3d-a8bb-3b138b869708-delete_volume" released by "delete_volume" :: held 3.967s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:20 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059 Jul 03 16:30:20 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.677s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:30:20 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:30:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:30:23 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059" returned: 0 in 2.927s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:23 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059 Jul 03 16:30:23 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:25 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4372cd33-73ae-4834-9c1d-668ad8c71059" returned: 0 in 2.057s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-4372cd33-73ae-4834-9c1d-668ad8c71059" released by "delete_volume" :: held 5.112s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:25 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Created reservations ['45cb8e22-4d48-43db-adac-6d112f367612', '4e98be39-c40f-43b1-b715-637ac3bacee1', 'fbe7b3bd-3ebb-49af-843e-948957503e39', 'bcf014f8-60b4-461b-80c0-e732f25dbade'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:30:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:25 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:30:25 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-86a61231-f930-4fae-815a-25a6aaa88001-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-86a61231-f930-4fae-815a-25a6aaa88001-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "cinder-quobyte-86a61231-f930-4fae-815a-25a6aaa88001" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:27 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-86a61231-f930-4fae-815a-25a6aaa88001" acquired by "delete_volume" :: waited 0.073s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:27 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[666a5b84-92f8-443a-8d89-12e3b5c265f5]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:27 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.563s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:27 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:30:27 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Deleted volume successfully. Jul 03 16:30:27 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e2e30158-b17c-456a-989d-05982e700e8b tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-4372cd33-73ae-4834-9c1d-668ad8c71059-delete_volume" released by "delete_volume" :: held 7.359s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:27 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001 Jul 03 16:30:27 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:27 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" returned: 0 in 8.728s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:27 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa21038-6e93-41ee-8933-4b18f4168c97]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:28 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a Jul 03 16:30:28 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:28 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001" returned: 0 in 1.547s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:28 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001 Jul 03 16:30:28 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:29 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a" returned: 0 in 1.377s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:29 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:30:29 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Converted 1024.00 MB image at 117.26 MB/s Jul 03 16:30:29 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 is being set with open permissions: ugo+rw Jul 03 16:30:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:29 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 Jul 03 16:30:29 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:29 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-86a61231-f930-4fae-815a-25a6aaa88001" returned: 0 in 1.275s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-quobyte-86a61231-f930-4fae-815a-25a6aaa88001" released by "delete_volume" :: held 2.961s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Created reservations ['93a64cf8-a529-40be-869c-ec1235f3ca9a', '3b416499-9a0d-46e6-984e-824b35fd8667', '4fc251ea-889e-40cb-924c-a671ff6aa1fc', '543a0009-928e-4235-a6ad-14b54ae7b6fa'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:30 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:30:30 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:30 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" returned: 0 in 1.302s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" released by "_copy_volume_from_snapshot" :: held 14.100s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-0934c72b-53f7-4370-a3a6-d1c915b511e0-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" released by "_create_volume_from_snapshot" :: held 14.177s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.226s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4f2e9-fdc3-474d-adf6-adf4483b079c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3', 'volume_size': 2, 'snapshot_id': '0934c72b-53f7-4370-a3a6-d1c915b511e0'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2543fb-a23a-4f37-b339-76cf58bfd6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:30 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Volume volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 (d6e837ad-5a45-47cd-a0f8-a5f5358e34d3): created successfully Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2543fb-a23a-4f37-b339-76cf58bfd6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (981fd4ea-ce73-48a9-8f82-015f1d710ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:30 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3d3bd074-5d9a-4874-97d9-4292f88f1ed9 tempest-VolumesSnapshotTestJSON-91942839 None] Created volume successfully. Jul 03 16:30:31 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.827s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:31 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:30:31 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Deleted volume successfully. Jul 03 16:30:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-92c33879-9285-402d-9897-69bfec96ee28 tempest-CreateVolumesFromImageTest-1122688777 None] Lock "cinder-86a61231-f930-4fae-815a-25a6aaa88001-delete_volume" released by "delete_volume" :: held 4.467s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:31 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3738c733-bc93-4ba4-852d-f9b6fcd6f0eb]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:31 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 Jul 03 16:30:31 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:32 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" returned: 0 in 1.118s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:32 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3 Jul 03 16:30:32 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:34 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" returned: 0 in 1.192s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3" released by "delete_volume" :: held 2.390s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Created reservations ['9f5af355-f2d1-4a8f-9e01-a015286bf481', '5082cddb-2670-45f0-9ffb-0baa84fe24c2', '2f592a4a-b40b-4edc-8e35-cdf89c5225b5', '3bf980a4-4ce1-49c4-a8af-41be23c07ea9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Flow 'volume_create_manager' (d9a85c9d-d0b2-4810-a446-8f3c831c9ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8512db3-b14f-4c38-9ee4-096843a37ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8512db3-b14f-4c38-9ee4-096843a37ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2065333628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270e92ed-031c-4633-b6c5-c75bb925bcf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a607c71156db483bac78378b2fae5f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:34Z,use_quota=True,user_id='2877a2ad03964deb8919a50b928f538c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7f5eaf-983c-427d-8037-28498cf262b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7f5eaf-983c-427d-8037-28498cf262b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9305a1-f57b-4948-8d42-4bafcb88b0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9305a1-f57b-4948-8d42-4bafcb88b0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270e92ed-031c-4633-b6c5-c75bb925bcf6', 'volume_name': 'volume-270e92ed-031c-4633-b6c5-c75bb925bcf6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afaac662-79dd-4103-ae27-a6469343ac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afaac662-79dd-4103-ae27-a6469343ac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc4849b-cbd0-4141-bfb8-d4867bbf3b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:34 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Volume 270e92ed-031c-4633-b6c5-c75bb925bcf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270e92ed-031c-4633-b6c5-c75bb925bcf6', 'volume_size': 1} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2065333628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270e92ed-031c-4633-b6c5-c75bb925bcf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a607c71156db483bac78378b2fae5f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:34Z,use_quota=True,user_id='2877a2ad03964deb8919a50b928f538c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Creating volume 270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:30:34 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:34 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 1073741824 Jul 03 16:30:34 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:34 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:30:34 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-0934c72b-53f7-4370-a3a6-d1c915b511e0-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-0934c72b-53f7-4370-a3a6-d1c915b511e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-3e07b703-cc39-42f2-8d19-3fab025c287a" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-3e07b703-cc39-42f2-8d19-3fab025c287a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-0934c72b-53f7-4370-a3a6-d1c915b511e0" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-0934c72b-53f7-4370-a3a6-d1c915b511e0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Deleting offline snapshot 0934c72b-53f7-4370-a3a6-d1c915b511e0 of volume 3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] snapshot_file for this snap is: volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[69993491-b4ff-4cf7-9375-1c9c60404bd7]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:35 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 Jul 03 16:30:35 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:35 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.167s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:30:35 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Deleted volume successfully. Jul 03 16:30:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d4ec61d0-ae9a-4d18-8525-5ab26989c00f tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-d6e837ad-5a45-47cd-a0f8-a5f5358e34d3-delete_volume" released by "delete_volume" :: held 4.114s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:36 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 1073741824" returned: 0 in 1.548s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:36 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 Jul 03 16:30:36 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:36 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0" returned: 0 in 1.138s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e07b703-cc39-42f2-8d19-3fab025c287a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:30:36 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7986b50-5261-408d-bb90-3b000187166b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:36 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a Jul 03 16:30:36 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:37 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6" returned: 0 in 0.934s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] <== create_volume: return (2558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:30:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.561s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc4849b-cbd0-4141-bfb8-d4867bbf3b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270e92ed-031c-4633-b6c5-c75bb925bcf6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9ffb6f-0e01-4cf4-97e5-f666ab7e6285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Volume volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 (270e92ed-031c-4633-b6c5-c75bb925bcf6): created successfully Jul 03 16:30:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9ffb6f-0e01-4cf4-97e5-f666ab7e6285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Flow 'volume_create_manager' (d9a85c9d-d0b2-4810-a446-8f3c831c9ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b82c61c6-2cb1-4b95-9d6f-4a29d873ffa8 tempest-SnapshotDependencyTests-904418129 None] Created volume successfully. Jul 03 16:30:37 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a" returned: 0 in 1.198s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:37 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 Jul 03 16:30:37 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Creating offline snapshot 6e8a5389-fa57-4109-be09-b0022febfb53 of volume 270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:30:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[62db7e0f-e963-41d5-ba95-8148b1e956e4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:38 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 Jul 03 16:30:38 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:39 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0" returned: 0 in 1.243s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:39 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0 Jul 03 16:30:39 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:39 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6" returned: 0 in 1.192s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:39 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 1G Jul 03 16:30:39 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:40 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a.0934c72b-53f7-4370-a3a6-d1c915b511e0" returned: 0 in 0.937s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-0934c72b-53f7-4370-a3a6-d1c915b511e0" released by "_delete_snapshot" :: held 4.699s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-3e07b703-cc39-42f2-8d19-3fab025c287a" released by "delete_snapshot" :: held 4.741s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Created reservations ['2daf5930-9fc8-4d2b-b74f-a867425442c9', 'fe45bbc9-a696-4aa5-8b21-6ef2f8816068', 'b930e335-2e41-4d24-8223-9bef085503b5', '343a8c08-dac5-484a-9306-2d3335d07dd7'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:30:40 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Delete snapshot completed successfully. Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bed33523-b705-4e63-9e6c-6c9f514efb3e tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-0934c72b-53f7-4370-a3a6-d1c915b511e0-delete_snapshot" released by "delete_snapshot" :: held 5.015s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:40 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 1G" returned: 0 in 1.307s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:40 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 Jul 03 16:30:40 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-3e07b703-cc39-42f2-8d19-3fab025c287a-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-3e07b703-cc39-42f2-8d19-3fab025c287a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-3e07b703-cc39-42f2-8d19-3fab025c287a" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-3e07b703-cc39-42f2-8d19-3fab025c287a" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[59997558-da29-4349-a719-98b6341384a1]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:41 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a Jul 03 16:30:41 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:41 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Flow 'volume_create_manager' (6f6bf43a-c440-4c00-a7f9-6e3acb333a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c8cac0-4cc7-4d41-8fc8-eacf984d0350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53" returned: 0 in 1.053s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:41 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 is being set with open permissions: ugo+rw Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c8cac0-4cc7-4d41-8fc8-eacf984d0350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164cdd3f-ff75-45af-ba0e-f11dee13db81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946a12d88354484792272650e3d60463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:42Z,use_quota=True,user_id='b4791cdbf35c4a97b020485458f9341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2637315f-7307-4bf3-8065-514d2bf45e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2637315f-7307-4bf3-8065-514d2bf45e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:41 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 Jul 03 16:30:41 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e96ec2-3e74-4260-809c-1e5329dc171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:41 devstack cinder-volume[86659]: DEBUG cinder.image.glance [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Creating Keystone auth plugin from conf {{(pid=86659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 16:30:42 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a" returned: 0 in 1.050s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:42 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a Jul 03 16:30:42 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e96ec2-3e74-4260-809c-1e5329dc171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '164cdd3f-ff75-45af-ba0e-f11dee13db81', 'volume_name': 'volume-164cdd3f-ff75-45af-ba0e-f11dee13db81', 'volume_size': 1, 'image_id': '24444d14-dc36-4250-a772-8d5a4de8e69c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24444d14-dc36-4250-a772-8d5a4de8e69c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e66790263079b1a0292d08160310b48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '946a12d88354484792272650e3d60463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b1468679ff740e6a876c6c1b9aabcf2dcd5e616ef7c4f52bf5327d730c8fc5c25da32df205c3212835fe945e1e72c372980e93fb66e88d90a7b03a39ca0ec1f', 'id': '24444d14-dc36-4250-a772-8d5a4de8e69c', 'created_at': datetime.datetime(2026, 7, 3, 14, 30, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 30, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24444d14-dc36-4250-a772-8d5a4de8e69c/file', 'properties': {}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3618dc2c-5712-4a8e-a104-ca4d4ebb3801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3618dc2c-5712-4a8e-a104-ca4d4ebb3801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4418e8e-0d16-476b-91f4-fb7b67c763dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:42 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Volume 164cdd3f-ff75-45af-ba0e-f11dee13db81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-164cdd3f-ff75-45af-ba0e-f11dee13db81', 'volume_size': 1, 'image_id': '24444d14-dc36-4250-a772-8d5a4de8e69c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24444d14-dc36-4250-a772-8d5a4de8e69c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e66790263079b1a0292d08160310b48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '946a12d88354484792272650e3d60463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b1468679ff740e6a876c6c1b9aabcf2dcd5e616ef7c4f52bf5327d730c8fc5c25da32df205c3212835fe945e1e72c372980e93fb66e88d90a7b03a39ca0ec1f', 'id': '24444d14-dc36-4250-a772-8d5a4de8e69c', 'created_at': datetime.datetime(2026, 7, 3, 14, 30, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 30, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24444d14-dc36-4250-a772-8d5a4de8e69c/file', 'properties': {}}, 'image_service': } Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Trying to clone 164cdd3f-ff75-45af-ba0e-f11dee13db81 from image 24444d14-dc36-4250-a772-8d5a4de8e69c at location (None, [{'url': 'file:///opt/stack/data/glance/images/24444d14-dc36-4250-a772-8d5a4de8e69c', 'metadata': {}}]). {{(pid=86659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 16:30:42 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Image download 0.00 MB at 0.00 MB/s Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d994967-e75c-4411-9fe8-d52b22d5eba8]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:42 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53" returned: 0 in 0.917s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:42 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.info Jul 03 16:30:42 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:42 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD Jul 03 16:30:42 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:43 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3e07b703-cc39-42f2-8d19-3fab025c287a" returned: 0 in 1.009s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-3e07b703-cc39-42f2-8d19-3fab025c287a" released by "delete_volume" :: held 2.167s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Created reservations ['4b350f8a-9fd3-4b4d-b78e-e75f5a880763', '5e75bbcd-8320-4814-9c7c-e5ce472f3a27', 'f5ecef8d-b272-4394-9255-363772b8f0a6', '8353f250-6303-4ae5-86a5-794126b55a7f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:43 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:30:43 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:43 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.info" returned: 0 in 0.843s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:43 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.info is being set with open permissions: ugo+rw Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:43 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD" returned: 0 in 0.946s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:43 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.info Jul 03 16:30:43 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:43 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD Jul 03 16:30:43 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:44 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.086s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:30:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Deleted volume successfully. Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3b244ba1-2b74-483c-862c-f765423a3ccd tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-3e07b703-cc39-42f2-8d19-3fab025c287a-delete_volume" released by "delete_volume" :: held 3.591s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:44 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.info" returned: 0 in 1.069s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.544s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4f66a7f9-6785-400a-8d18-2aec0e5a8d53 tempest-SnapshotDependencyTests-904418129 None] Create snapshot completed successfully Jul 03 16:30:44 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD" returned: 1 in 1.256s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Temporary image 24444d14-dc36-4250-a772-8d5a4de8e69c is fetched for user b4791cdbf35c4a97b020485458f9341d. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e392a0-ddf7-48f5-b575-654631e6f19c]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:44 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD Jul 03 16:30:44 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (6fa9cfea-7be1-441f-96fd-c10e5a96ed54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c288cb6-da4f-43d9-88b2-ae394bdbaf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c288cb6-da4f-43d9-88b2-ae394bdbaf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1679330701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d001e426-21bf-4f3e-89d2-57f91e6e60ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cfdffe6adf470dad82d4ad77a660cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:45Z,use_quota=True,user_id='fb57c871fb334655bebeeafc1935fd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37028820-3e0a-4c4a-bbee-3e281636f3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37028820-3e0a-4c4a-bbee-3e281636f3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07be461-a873-4f79-9a1d-a2325b3e24b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07be461-a873-4f79-9a1d-a2325b3e24b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd001e426-21bf-4f3e-89d2-57f91e6e60ac', 'volume_name': 'volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5397cf-5848-4f9e-b682-3fbe0129cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5397cf-5848-4f9e-b682-3fbe0129cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7044bd38-82f8-4116-94c6-dd6c24c7e307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:45 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Volume d001e426-21bf-4f3e-89d2-57f91e6e60ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac', 'volume_size': 1} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1679330701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d001e426-21bf-4f3e-89d2-57f91e6e60ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cfdffe6adf470dad82d4ad77a660cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:45Z,use_quota=True,user_id='fb57c871fb334655bebeeafc1935fd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Creating volume d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:30:45 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:45 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac 1073741824 Jul 03 16:30:45 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:45 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD" returned: 0 in 1.003s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:46 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD Jul 03 16:30:46 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:46 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac 1073741824" returned: 0 in 1.340s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:46 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac Jul 03 16:30:46 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Flow 'volume_create_manager' (ff28942b-aa2c-475d-879c-04f39f21a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f8b805-6b39-461e-a5a7-65bf848d0915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f8b805-6b39-461e-a5a7-65bf848d0915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df0afbc-2c1d-47b3-81ab-353355c1748a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a607c71156db483bac78378b2fae5f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6e8a5389-fa57-4109-be09-b0022febfb53,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:47Z,use_quota=True,user_id='2877a2ad03964deb8919a50b928f538c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e7a99e-225f-428a-a59b-bac31db955ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e7a99e-225f-428a-a59b-bac31db955ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5906c0-dd41-407c-8cce-bb9ad5a52840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5906c0-dd41-407c-8cce-bb9ad5a52840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6df0afbc-2c1d-47b3-81ab-353355c1748a', 'volume_name': 'volume-6df0afbc-2c1d-47b3-81ab-353355c1748a', 'volume_size': 1, 'snapshot_id': '6e8a5389-fa57-4109-be09-b0022febfb53'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3573cffd-d3f0-44eb-a682-637d5468f680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3573cffd-d3f0-44eb-a682-637d5468f680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea599d5-3fb7-44cb-b2d7-0a82262c9686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:46 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Volume 6df0afbc-2c1d-47b3-81ab-353355c1748a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6df0afbc-2c1d-47b3-81ab-353355c1748a', 'volume_size': 1, 'snapshot_id': '6e8a5389-fa57-4109-be09-b0022febfb53'} Jul 03 16:30:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:47 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD" returned: 1 in 1.441s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:47 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac" returned: 0 in 1.095s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] <== create_volume: return (2540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.543s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.909s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "cinder-quobyte-6e8a5389-fa57-4109-be09-b0022febfb53-6df0afbc-2c1d-47b3-81ab-353355c1748a" by "_create_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7044bd38-82f8-4116-94c6-dd6c24c7e307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aee1025-4604-48ee-9d40-a0bc6e14641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-6e8a5389-fa57-4109-be09-b0022febfb53-6df0afbc-2c1d-47b3-81ab-353355c1748a" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Creating volume 6df0afbc-2c1d-47b3-81ab-353355c1748a from snapshot 6e8a5389-fa57-4109-be09-b0022febfb53 {{(pid=86659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "cinder-quobyte-6df0afbc-2c1d-47b3-81ab-353355c1748a" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:47 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Volume volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac (d001e426-21bf-4f3e-89d2-57f91e6e60ac): created successfully Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aee1025-4604-48ee-9d40-a0bc6e14641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (6fa9cfea-7be1-441f-96fd-c10e5a96ed54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-6df0afbc-2c1d-47b3-81ab-353355c1748a" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] snapshot: 6e8a5389-fa57-4109-be09-b0022febfb53, volume: 6df0afbc-2c1d-47b3-81ab-353355c1748a, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:47 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-399d7a00-ce1d-432c-866f-03825e377e7d tempest-VolumesSnapshotTestJSON-91942839 None] Created volume successfully. Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[60269c9f-fdba-47a2-8260-c2846462e639]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:48 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 Jul 03 16:30:48 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:48 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53" returned: 0 in 1.088s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-270e92ed-031c-4633-b6c5-c75bb925bcf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:30:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:30:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:30:49 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[026ad90e-9357-42ee-8354-fd10570d2bb3]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:49 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 Jul 03 16:30:49 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:50 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6" returned: 0 in 1.114s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:50 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:30:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:50 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a Jul 03 16:30:50 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Flow 'volume_create_manager' (7c7de62b-88f8-4e6d-871a-778f6428ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd37108-1eec-4aa6-bd8b-0a8b5e685418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd37108-1eec-4aa6-bd8b-0a8b5e685418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1748058222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297d5e35-a5ca-4f67-889f-8ce2f841db64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8916c5b94ca943c3a85dc8622329a7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:56Z,use_quota=True,user_id='a2e308ad9a9b4b23a163f8804338187d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fc6d40-786c-4a3b-85ac-423046e0ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fc6d40-786c-4a3b-85ac-423046e0ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a022a9d-4216-49a1-a9de-38c4bfe4e4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a022a9d-4216-49a1-a9de-38c4bfe4e4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '297d5e35-a5ca-4f67-889f-8ce2f841db64', 'volume_name': 'volume-297d5e35-a5ca-4f67-889f-8ce2f841db64', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a24a925-b3d1-4d1f-8fac-15a99831b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a24a925-b3d1-4d1f-8fac-15a99831b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7c867f-9e59-4552-9d7b-3f001861e41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:56 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Volume 297d5e35-a5ca-4f67-889f-8ce2f841db64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-297d5e35-a5ca-4f67-889f-8ce2f841db64', 'volume_size': 1} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:56 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a" returned: 0 in 6.198s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d1d9ec-a6fe-45b2-b75b-e0064e573be2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:56 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 Jul 03 16:30:56 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:57 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6" returned: 0 in 1.066s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:57 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:30:57 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Converted 1024.00 MB image at 165.19 MB/s Jul 03 16:30:57 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a is being set with open permissions: ugo+rw Jul 03 16:30:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:57 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a Jul 03 16:30:57 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:58 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a" returned: 0 in 0.736s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-6df0afbc-2c1d-47b3-81ab-353355c1748a" released by "_copy_volume_from_snapshot" :: held 10.350s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-6e8a5389-fa57-4109-be09-b0022febfb53-6df0afbc-2c1d-47b3-81ab-353355c1748a" released by "_create_volume_from_snapshot" :: held 10.410s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.463s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.906s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164cdd3f-ff75-45af-ba0e-f11dee13db81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946a12d88354484792272650e3d60463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:42Z,use_quota=True,user_id='b4791cdbf35c4a97b020485458f9341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Creating volume 164cdd3f-ff75-45af-ba0e-f11dee13db81 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:30:58 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:58 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 1073741824 Jul 03 16:30:58 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea599d5-3fb7-44cb-b2d7-0a82262c9686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df0afbc-2c1d-47b3-81ab-353355c1748a', 'volume_size': 1, 'snapshot_id': '6e8a5389-fa57-4109-be09-b0022febfb53'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc57c162-41f6-4ed7-9fb2-6e314c1c652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:30:58 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Volume volume-6df0afbc-2c1d-47b3-81ab-353355c1748a (6df0afbc-2c1d-47b3-81ab-353355c1748a): created successfully Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc57c162-41f6-4ed7-9fb2-6e314c1c652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:30:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Flow 'volume_create_manager' (ff28942b-aa2c-475d-879c-04f39f21a756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:30:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-8774ad44-63fe-47b8-ac97-fdf69a118c8f tempest-SnapshotDependencyTests-904418129 None] Created volume successfully. Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "cinder-6e8a5389-fa57-4109-be09-b0022febfb53-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-6e8a5389-fa57-4109-be09-b0022febfb53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "cinder-quobyte-270e92ed-031c-4633-b6c5-c75bb925bcf6" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-270e92ed-031c-4633-b6c5-c75bb925bcf6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "cinder-quobyte-6e8a5389-fa57-4109-be09-b0022febfb53" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-6e8a5389-fa57-4109-be09-b0022febfb53" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Deleting offline snapshot 6e8a5389-fa57-4109-be09-b0022febfb53 of volume 270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] snapshot_file for this snap is: volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[113990ca-8204-4884-bb75-1b5aa53e1952]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:59 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 1073741824" returned: 0 in 1.040s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:59 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 Jul 03 16:30:59 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:30:59 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 Jul 03 16:30:59 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:30:59 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81" returned: 0 in 0.716s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:30:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.359s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Creating offline snapshot 82a8d3bb-7784-4603-a224-50097b291014 of volume d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:31:00 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53" returned: 0 in 0.900s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-270e92ed-031c-4633-b6c5-c75bb925bcf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[007fc6bd-e1c4-412a-aca8-e6d8909c5df2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb3cb27-e5d5-4445-a510-a53ecccc29da]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Attempting download of 24444d14-dc36-4250-a772-8d5a4de8e69c ((None, [{'url': 'file:///opt/stack/data/glance/images/24444d14-dc36-4250-a772-8d5a4de8e69c', 'metadata': {}}])) to volume 164cdd3f-ff75-45af-ba0e-f11dee13db81. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8692167b-0564-49b7-be77-f3ea64fb791d]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24444d14-dc36-4250-a772-8d5a4de8e69c_cpx0aw9i {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:00 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac Jul 03 16:31:00 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:00 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 Jul 03 16:31:00 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:00 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24444d14-dc36-4250-a772-8d5a4de8e69c_cpx0aw9i Jul 03 16:31:00 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:00 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac" returned: 0 in 0.886s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:00 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24444d14-dc36-4250-a772-8d5a4de8e69c_cpx0aw9i" returned: 0 in 0.819s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24444d14-dc36-4250-a772-8d5a4de8e69c_cpx0aw9i {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:00 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 1G Jul 03 16:31:00 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:00 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6" returned: 0 in 0.926s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:01 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 Jul 03 16:31:01 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:01 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24444d14-dc36-4250-a772-8d5a4de8e69c_cpx0aw9i Jul 03 16:31:01 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:01 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24444d14-dc36-4250-a772-8d5a4de8e69c_cpx0aw9i" returned: 1 in 0.894s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24444d14-dc36-4250-a772-8d5a4de8e69c_cpx0aw9i' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[611b6308-35f4-4cb0-b609-28f61ba26112]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:01 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53" returned: 0 in 0.913s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:01 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 1G" returned: 0 in 1.000s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:01 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53 Jul 03 16:31:01 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:01 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 Jul 03 16:31:01 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:01 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD Jul 03 16:31:02 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:02 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6.6e8a5389-fa57-4109-be09-b0022febfb53" returned: 0 in 0.755s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-6e8a5389-fa57-4109-be09-b0022febfb53" released by "_delete_snapshot" :: held 3.714s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-270e92ed-031c-4633-b6c5-c75bb925bcf6" released by "delete_snapshot" :: held 3.752s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:02 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Created reservations ['b8b0c418-48ad-44ec-96ff-5cc58bd57241', 'e84f922a-a150-4b1f-bf7d-a7908e8c7d4b', '22b90768-cfc2-49f6-a7ab-5c3c2431e179', 'ee83c2d8-faba-4db9-9329-726cd27e43d4'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:31:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Delete snapshot completed successfully. Jul 03 16:31:03 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD" returned: 0 in 1.200s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a6a05899-4523-4de4-b5ef-89e0a2e77dc1 tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-6e8a5389-fa57-4109-be09-b0022febfb53-delete_snapshot" released by "delete_snapshot" :: held 4.015s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:03 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014" returned: 0 in 1.191s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:03 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 is being set with open permissions: ugo+rw Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:03 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 Jul 03 16:31:03 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:03 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD Jul 03 16:31:03 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "cinder-270e92ed-031c-4633-b6c5-c75bb925bcf6-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-270e92ed-031c-4633-b6c5-c75bb925bcf6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "cinder-quobyte-270e92ed-031c-4633-b6c5-c75bb925bcf6" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-270e92ed-031c-4633-b6c5-c75bb925bcf6" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecae2ac-c952-4e19-a098-8a14b85a31eb]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:03 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 Jul 03 16:31:03 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:04 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014" returned: 0 in 0.978s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:04 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD" returned: 1 in 1.123s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:31:04 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] 24444d14-dc36-4250-a772-8d5a4de8e69c was raw, converting to raw {{(pid=86659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 16:31:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:04 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 Jul 03 16:31:04 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:04 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.info Jul 03 16:31:04 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:04 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6" returned: 0 in 1.313s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:04 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6 Jul 03 16:31:04 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:05 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81" returned: 0 in 0.968s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24444d14-dc36-4250-a772-8d5a4de8e69c_lmj08gehdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:31:05 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:05 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 1G Jul 03 16:31:05 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:05 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.info" returned: 0 in 1.051s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:05 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.info is being set with open permissions: ugo+rw Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:05 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.info Jul 03 16:31:05 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:05 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-270e92ed-031c-4633-b6c5-c75bb925bcf6" returned: 0 in 0.768s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-270e92ed-031c-4633-b6c5-c75bb925bcf6" released by "delete_volume" :: held 2.194s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Created reservations ['11347a60-496d-4e7d-86ac-9d05cc98e611', '7e3eab5c-3754-4e3e-b929-f8e7012f9374', '90004109-5cc7-4550-a1fe-6db0b750b7d0', '468b7c7f-182c-4e1d-86d8-0415c79c4de9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:05 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:31:05 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:06 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 1G" returned: 0 in 0.945s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:06 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.info" returned: 0 in 0.897s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.203s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18239c9a-4bc7-4dd7-bc77-fecb280beca6]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.903s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1748058222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297d5e35-a5ca-4f67-889f-8ce2f841db64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8916c5b94ca943c3a85dc8622329a7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:30:56Z,use_quota=True,user_id='a2e308ad9a9b4b23a163f8804338187d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Creating volume 297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:31:06 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:06 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 1073741824 Jul 03 16:31:06 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:06 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a735cc74-4b09-4a75-beb3-418f4f4ce1cf tempest-VolumesSnapshotTestJSON-91942839 None] Create snapshot completed successfully Jul 03 16:31:06 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 Jul 03 16:31:06 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:06 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.837s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:31:06 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Deleted volume successfully. Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-08827ce0-308f-4955-8bba-f56ac1a2a53d tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-270e92ed-031c-4633-b6c5-c75bb925bcf6-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "cinder-6df0afbc-2c1d-47b3-81ab-353355c1748a-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-6df0afbc-2c1d-47b3-81ab-353355c1748a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "cinder-quobyte-6df0afbc-2c1d-47b3-81ab-353355c1748a" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-6df0afbc-2c1d-47b3-81ab-353355c1748a" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[713cdda0-74c8-4d32-a70b-50e10eb62de8]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:07 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81" returned: 0 in 1.032s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:07 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a Jul 03 16:31:07 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:07 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 Jul 03 16:31:07 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:07 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 1073741824" returned: 0 in 1.315s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:07 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 Jul 03 16:31:07 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (82132303-056b-4b73-87c5-42349ab61275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ba264d-f0f9-4e29-b3bc-f9c1e5127712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ba264d-f0f9-4e29-b3bc-f9c1e5127712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1507206129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca46f71b-e277-4cf5-8c52-45d18aca4366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4cfdffe6adf470dad82d4ad77a660cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82a8d3bb-7784-4603-a224-50097b291014,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:31:08Z,use_quota=True,user_id='fb57c871fb334655bebeeafc1935fd3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe5ea8e-2460-4e68-afcd-401045d835db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe5ea8e-2460-4e68-afcd-401045d835db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3529fdfc-3d5d-4a3c-8900-b0f4e3269de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3529fdfc-3d5d-4a3c-8900-b0f4e3269de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca46f71b-e277-4cf5-8c52-45d18aca4366', 'volume_name': 'volume-ca46f71b-e277-4cf5-8c52-45d18aca4366', 'volume_size': 1, 'snapshot_id': '82a8d3bb-7784-4603-a224-50097b291014'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c3d28d-097f-47de-b964-35c557f67be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c3d28d-097f-47de-b964-35c557f67be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4076bb0-529d-4fa9-b8b7-83f3d4a8b1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:31:08 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Volume ca46f71b-e277-4cf5-8c52-45d18aca4366: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca46f71b-e277-4cf5-8c52-45d18aca4366', 'volume_size': 1, 'snapshot_id': '82a8d3bb-7784-4603-a224-50097b291014'} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:08 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a" returned: 0 in 1.231s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:08 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a Jul 03 16:31:08 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:08 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:08 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64" returned: 0 in 0.901s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] <== create_volume: return (2332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.476s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-82a8d3bb-7784-4603-a224-50097b291014-ca46f71b-e277-4cf5-8c52-45d18aca4366" by "_create_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81" returned: 1 in 1.280s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Downloaded image 24444d14-dc36-4250-a772-8d5a4de8e69c ((None, [{'url': 'file:///opt/stack/data/glance/images/24444d14-dc36-4250-a772-8d5a4de8e69c', 'metadata': {}}])) to volume 164cdd3f-ff75-45af-ba0e-f11dee13db81 successfully. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Temporary image 24444d14-dc36-4250-a772-8d5a4de8e69c for user b4791cdbf35c4a97b020485458f9341d is deleted. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Marking volume 164cdd3f-ff75-45af-ba0e-f11dee13db81 as bootable. {{(pid=86659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7c867f-9e59-4552-9d7b-3f001861e41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297d5e35-a5ca-4f67-889f-8ce2f841db64', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e16b66-7c08-4d9c-8a5a-db5a56ded1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-82a8d3bb-7784-4603-a224-50097b291014-ca46f71b-e277-4cf5-8c52-45d18aca4366" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Creating volume ca46f71b-e277-4cf5-8c52-45d18aca4366 from snapshot 82a8d3bb-7784-4603-a224-50097b291014 {{(pid=86659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-ca46f71b-e277-4cf5-8c52-45d18aca4366" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Copying metadata from image 24444d14-dc36-4250-a772-8d5a4de8e69c to 164cdd3f-ff75-45af-ba0e-f11dee13db81. {{(pid=86659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Creating volume glance metadata for volume 164cdd3f-ff75-45af-ba0e-f11dee13db81 backed by image 24444d14-dc36-4250-a772-8d5a4de8e69c with: {'image_id': '24444d14-dc36-4250-a772-8d5a4de8e69c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5e66790263079b1a0292d08160310b48', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 16:31:08 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Volume volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 (297d5e35-a5ca-4f67-889f-8ce2f841db64): created successfully Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e16b66-7c08-4d9c-8a5a-db5a56ded1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Flow 'volume_create_manager' (7c7de62b-88f8-4e6d-871a-778f6428ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-ca46f71b-e277-4cf5-8c52-45d18aca4366" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] snapshot: 82a8d3bb-7784-4603-a224-50097b291014, volume: ca46f71b-e277-4cf5-8c52-45d18aca4366, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:31:08 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9d8d3d6b-810d-4db7-9362-b18bd9d5385c tempest-TestStampPattern-2042924185 None] Created volume successfully. Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[67307ae7-010c-475f-b10e-7b8c3ecf5c80]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4418e8e-0d16-476b-91f4-fb7b67c763dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164cdd3f-ff75-45af-ba0e-f11dee13db81', 'volume_size': 1, 'image_id': '24444d14-dc36-4250-a772-8d5a4de8e69c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24444d14-dc36-4250-a772-8d5a4de8e69c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e66790263079b1a0292d08160310b48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '946a12d88354484792272650e3d60463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b1468679ff740e6a876c6c1b9aabcf2dcd5e616ef7c4f52bf5327d730c8fc5c25da32df205c3212835fe945e1e72c372980e93fb66e88d90a7b03a39ca0ec1f', 'id': '24444d14-dc36-4250-a772-8d5a4de8e69c', 'created_at': datetime.datetime(2026, 7, 3, 14, 30, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 30, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24444d14-dc36-4250-a772-8d5a4de8e69c/file', 'properties': {}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fb4999-6895-41a3-a1d6-0cb2373e8d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:31:08 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Volume volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 (164cdd3f-ff75-45af-ba0e-f11dee13db81): created successfully Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fb4999-6895-41a3-a1d6-0cb2373e8d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Flow 'volume_create_manager' (6f6bf43a-c440-4c00-a7f9-6e3acb333a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:31:08 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e586085d-42b1-45e0-933a-b2e7cb610d7e tempest-VolumeImageDependencyTests-1992284132 None] Created volume successfully. Jul 03 16:31:08 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 Jul 03 16:31:08 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:09 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-6df0afbc-2c1d-47b3-81ab-353355c1748a" returned: 0 in 0.877s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-quobyte-6df0afbc-2c1d-47b3-81ab-353355c1748a" released by "delete_volume" :: held 2.169s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Created reservations ['e2cb7b51-0194-41d7-9681-efbe2bbf09d1', '6887e128-5f55-477a-9947-5cf00467d86b', '260a04d7-9185-46cd-9aa6-db877861a17f', '48d5a446-8bb0-4480-b490-617fd9bb5ebc'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:09 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:31:09 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Acquiring lock "cinder-164cdd3f-ff75-45af-ba0e-f11dee13db81-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Lock "cinder-164cdd3f-ff75-45af-ba0e-f11dee13db81-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Acquiring lock "cinder-quobyte-164cdd3f-ff75-45af-ba0e-f11dee13db81" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Lock "cinder-quobyte-164cdd3f-ff75-45af-ba0e-f11dee13db81" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cc7152-205c-4116-85c0-8c0769bd0518]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:09 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014" returned: 0 in 0.966s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec074b05-34e9-4b1d-8996-acdde58438ba]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:09 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 Jul 03 16:31:09 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:09 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac Jul 03 16:31:09 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:10 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.831s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:10 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:31:10 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Deleted volume successfully. Jul 03 16:31:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c85e466-d8c0-47ca-b96d-aea6bb4a7c0e tempest-SnapshotDependencyTests-904418129 None] Lock "cinder-6df0afbc-2c1d-47b3-81ab-353355c1748a-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:11 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81" returned: 0 in 1.396s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:11 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 Jul 03 16:31:11 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:11 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac" returned: 0 in 1.523s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:11 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:31:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:11 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 Jul 03 16:31:11 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:12 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81" returned: 1 in 1.556s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:31:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:12 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81 Jul 03 16:31:12 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:15 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-164cdd3f-ff75-45af-ba0e-f11dee13db81" returned: 0 in 2.761s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Lock "cinder-quobyte-164cdd3f-ff75-45af-ba0e-f11dee13db81" released by "delete_volume" :: held 5.845s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=89,cinder:UPDATE=100,cinder:INSERT=34,cinder:DELETE=6 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=103,cinder:SELECT=79,cinder:DELETE=12,cinder:INSERT=22 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Created reservations ['e6a8015b-8c6e-46a2-a8dd-04eec71a0245', '78ba4768-dbf1-49b1-8923-c40bb5c7a18f', '60074fa7-e49b-442d-b414-d4e1e391577c', 'e72a9db9-03f6-49d7-a980-3b8ed5ca7d53'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:16 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:31:16 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:18 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 2.465s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:18 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:31:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Deleted volume successfully. Jul 03 16:31:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e09deaa6-a85a-4b82-8188-84f667759b99 tempest-VolumeImageDependencyTests-1992284132 None] Lock "cinder-164cdd3f-ff75-45af-ba0e-f11dee13db81-delete_volume" released by "delete_volume" :: held 9.062s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:31:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:19 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:31:19 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:21 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 2.703s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:21 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:31:21 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:31:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:31:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:31:21 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366" returned: 0 in 10.483s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:21 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf9b968-1476-4ad7-9431-8008aa5c7d6c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:22 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac Jul 03 16:31:22 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:23 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac" returned: 0 in 2.032s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:23 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac, size 1024.00 MB, duration 10.49 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:31:23 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Converted 1024.00 MB image at 97.65 MB/s Jul 03 16:31:23 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 is being set with open permissions: ugo+rw Jul 03 16:31:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:23 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 Jul 03 16:31:23 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:25 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366" returned: 0 in 1.543s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-ca46f71b-e277-4cf5-8c52-45d18aca4366" released by "_copy_volume_from_snapshot" :: held 16.843s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-82a8d3bb-7784-4603-a224-50097b291014-ca46f71b-e277-4cf5-8c52-45d18aca4366" released by "_create_volume_from_snapshot" :: held 16.904s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.945s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4076bb0-529d-4fa9-b8b7-83f3d4a8b1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca46f71b-e277-4cf5-8c52-45d18aca4366', 'volume_size': 1, 'snapshot_id': '82a8d3bb-7784-4603-a224-50097b291014'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57560f0c-8508-4137-a380-82e3ed33ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:31:25 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Volume volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 (ca46f71b-e277-4cf5-8c52-45d18aca4366): created successfully Jul 03 16:31:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57560f0c-8508-4137-a380-82e3ed33ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:31:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Flow 'volume_create_manager' (82132303-056b-4b73-87c5-42349ab61275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:31:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-bd5133ba-00fa-4268-9b3b-ee278ed9947d tempest-VolumesSnapshotTestJSON-91942839 None] Created volume successfully. Jul 03 16:31:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-ca46f71b-e277-4cf5-8c52-45d18aca4366-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-ca46f71b-e277-4cf5-8c52-45d18aca4366-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-ca46f71b-e277-4cf5-8c52-45d18aca4366" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-ca46f71b-e277-4cf5-8c52-45d18aca4366" acquired by "delete_volume" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a05ba3c-8580-4b73-85df-f39e281191fd]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:26 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 Jul 03 16:31:26 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:27 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366" returned: 0 in 1.174s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:27 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366 Jul 03 16:31:27 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:28 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-ca46f71b-e277-4cf5-8c52-45d18aca4366" returned: 0 in 0.799s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-ca46f71b-e277-4cf5-8c52-45d18aca4366" released by "delete_volume" :: held 2.035s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:28 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Created reservations ['0ba67101-adf5-449e-8e60-7a5aa94eaab3', '50e18db0-f18b-43aa-920c-d69fdf8fe46d', '2b864304-9aa6-4c31-84f8-a11a6d53f1b5', '0c042c4b-6579-4796-ab56-7059b9a8a2a2'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:31:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:28 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:31:28 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:29 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.893s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:31:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Deleted volume successfully. Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-097b3a4f-1bb4-4e03-89aa-ba67b51fdecc tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-ca46f71b-e277-4cf5-8c52-45d18aca4366-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-82a8d3bb-7784-4603-a224-50097b291014-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-82a8d3bb-7784-4603-a224-50097b291014-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-d001e426-21bf-4f3e-89d2-57f91e6e60ac" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-d001e426-21bf-4f3e-89d2-57f91e6e60ac" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-82a8d3bb-7784-4603-a224-50097b291014" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-82a8d3bb-7784-4603-a224-50097b291014" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Deleting offline snapshot 82a8d3bb-7784-4603-a224-50097b291014 of volume d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] snapshot_file for this snap is: volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de839af-1f64-4162-b766-68538110249d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:29 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 Jul 03 16:31:29 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:30 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014" returned: 0 in 1.111s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:31:30 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fda8e17-cc1a-4e0c-8b47-cb5f0baae1b0]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:31 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac Jul 03 16:31:31 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:32 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac" returned: 0 in 1.123s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:32 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 Jul 03 16:31:32 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:33 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014" returned: 0 in 1.017s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:33 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014 Jul 03 16:31:33 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:33 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac.82a8d3bb-7784-4603-a224-50097b291014" returned: 0 in 0.649s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-82a8d3bb-7784-4603-a224-50097b291014" released by "_delete_snapshot" :: held 4.034s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-d001e426-21bf-4f3e-89d2-57f91e6e60ac" released by "delete_snapshot" :: held 4.056s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:33 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Created reservations ['24b0dfc5-8ef0-47c5-aafd-f2392f423f50', 'fb694590-563a-4a57-89d5-d5aa441e4781', '2b64252d-b493-412f-991d-347869d3af1e', 'f436574f-c1f7-44ef-a9ae-92234830700c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:31:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Delete snapshot completed successfully. Jul 03 16:31:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e1179d62-88df-4306-a9d4-a4f12df8563c tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-82a8d3bb-7784-4603-a224-50097b291014-delete_snapshot" released by "delete_snapshot" :: held 4.211s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-d001e426-21bf-4f3e-89d2-57f91e6e60ac-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-d001e426-21bf-4f3e-89d2-57f91e6e60ac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-d001e426-21bf-4f3e-89d2-57f91e6e60ac" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-d001e426-21bf-4f3e-89d2-57f91e6e60ac" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5427aff-e48d-41cb-84d6-e9fad0a3852c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:34 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac Jul 03 16:31:34 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:34 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac" returned: 0 in 0.750s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:34 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac Jul 03 16:31:34 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:35 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d001e426-21bf-4f3e-89d2-57f91e6e60ac" returned: 0 in 0.656s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-d001e426-21bf-4f3e-89d2-57f91e6e60ac" released by "delete_volume" :: held 1.471s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:35 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Created reservations ['759cd7c7-25db-4670-a26c-50955b6c7416', '6c61129a-d535-45f9-aade-865737664c28', '0be2b912-e454-47a4-a3ee-e7be0b38ba6f', '72be0e48-a85a-4d22-8f20-8678b29bde66'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:31:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:35 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:31:35 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-92c1f76f-8ea2-4295-ac51-b45bfc938bb6-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-92c1f76f-8ea2-4295-ac51-b45bfc938bb6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "cinder-quobyte-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:31:36 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.760s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:36 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:31:36 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Deleted volume successfully. Jul 03 16:31:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:31:36 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dc186f-faa5-4a4b-bdaa-3fa363b00a8f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7d0c484f-6e8e-4049-9410-9f4ef6a1ae99 tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-d001e426-21bf-4f3e-89d2-57f91e6e60ac-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:36 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 Jul 03 16:31:36 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-d482c7a5-7cc1-46f7-9508-c8af721bf2e1 req-0f49bad2-ca1a-43ca-90d4-c707bbb6c8a9 tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-d482c7a5-7cc1-46f7-9508-c8af721bf2e1 req-0f49bad2-ca1a-43ca-90d4-c707bbb6c8a9 tempest-TestStampPattern-2042924185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:37 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1b7526-2d5e-4436-b111-72cbae2f91cc]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-d482c7a5-7cc1-46f7-9508-c8af721bf2e1 req-0f49bad2-ca1a-43ca-90d4-c707bbb6c8a9 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:37 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" returned: 0 in 0.814s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:37 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6 Jul 03 16:31:37 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:37 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 Jul 03 16:31:37 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:38 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" returned: 0 in 0.687s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-quobyte-92c1f76f-8ea2-4295-ac51-b45bfc938bb6" released by "delete_volume" :: held 1.575s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:38 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-d482c7a5-7cc1-46f7-9508-c8af721bf2e1 req-0f49bad2-ca1a-43ca-90d4-c707bbb6c8a9 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64" returned: 0 in 0.809s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-d482c7a5-7cc1-46f7-9508-c8af721bf2e1 req-0f49bad2-ca1a-43ca-90d4-c707bbb6c8a9 tempest-TestStampPattern-2042924185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.829s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-d482c7a5-7cc1-46f7-9508-c8af721bf2e1 req-0f49bad2-ca1a-43ca-90d4-c707bbb6c8a9 tempest-TestStampPattern-2042924185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-297d5e35-a5ca-4f67-889f-8ce2f841db64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eca29816-1d0f-4dfe-8b10-d3aa9ae0ab4e', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Created reservations ['78232470-a22d-4fc7-84d2-cc130aabed0f', '99b3b0bb-1f9d-44cd-a68a-849fa39a8cf5', 'eb964746-9b25-40ad-a41a-2fd8b98d0333', '72cb35ee-ae85-4361-86d7-87a4af93c773'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:31:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-d482c7a5-7cc1-46f7-9508-c8af721bf2e1 req-0f49bad2-ca1a-43ca-90d4-c707bbb6c8a9 tempest-TestStampPattern-2042924185 None] attachment_update completed successfully. Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:38 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:31:38 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:38 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.696s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:39 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:31:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Deleted volume successfully. Jul 03 16:31:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e22d7400-f0e0-4f70-8661-b5c4a13c4afe tempest-VolumesSnapshotTestJSON-91942839 None] Lock "cinder-92c1f76f-8ea2-4295-ac51-b45bfc938bb6-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:31:47 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-00b6d9c3-2345-4ccd-bb87-e02fab4c2642 req-7ffe7a1a-62f1-4f33-b24a-092db47e6658 tempest-TestStampPattern-2042924185 None] Terminate volume connection completed successfully. Jul 03 16:31:47 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-00b6d9c3-2345-4ccd-bb87-e02fab4c2642 req-7ffe7a1a-62f1-4f33-b24a-092db47e6658 tempest-TestStampPattern-2042924185 None] Deleting attachment eca29816-1d0f-4dfe-8b10-d3aa9ae0ab4e. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:31:48 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=32,cinder:INSERT=9,cinder:UPDATE=46,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:31:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:31:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:31:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Creating offline snapshot d9f3c51e-2e60-4450-ae9a-e7662b63a383 of volume 297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:31:49 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed1bc0-c806-4ae1-98f6-bbed620c9abc]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:31:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:49 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 Jul 03 16:31:49 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:50 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64" returned: 0 in 1.024s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:50 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 1G Jul 03 16:31:50 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:51 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 1G" returned: 0 in 1.139s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:51 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 Jul 03 16:31:51 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:52 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383" returned: 0 in 0.934s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:52 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 is being set with open permissions: ugo+rw Jul 03 16:31:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:52 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 Jul 03 16:31:52 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:53 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383" returned: 0 in 0.733s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:53 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.info Jul 03 16:31:53 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:54 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.info" returned: 0 in 0.846s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:54 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.info is being set with open permissions: ugo+rw Jul 03 16:31:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:31:54 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.info Jul 03 16:31:54 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:31:55 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 03 16:31:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.info" returned: 0 in 0.861s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:31:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.672s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:31:55 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d0bb0e1f-0632-4d81-9037-a99a20e5a358 tempest-TestStampPattern-2042924185 None] Create snapshot completed successfully Jul 03 16:32:05 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:32:05 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=34,cinder:INSERT=11,cinder:UPDATE=37,cinder:DELETE=5 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Flow 'volume_create_manager' (d4b54f4a-d597-47e0-8e9a-5f52df65d3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac6775a-d703-4b9d-9e03-5ea99d70abd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac6775a-d703-4b9d-9e03-5ea99d70abd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1714731830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a4a39b-ed71-4240-9540-b313ca7863eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8916c5b94ca943c3a85dc8622329a7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9f3c51e-2e60-4450-ae9a-e7662b63a383,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:32:07Z,use_quota=True,user_id='a2e308ad9a9b4b23a163f8804338187d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46db1d5a-6a89-4f62-bb5d-416e05f1bf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46db1d5a-6a89-4f62-bb5d-416e05f1bf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294cef86-3902-4e8d-8445-09c6d04c9fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294cef86-3902-4e8d-8445-09c6d04c9fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2a4a39b-ed71-4240-9540-b313ca7863eb', 'volume_name': 'volume-c2a4a39b-ed71-4240-9540-b313ca7863eb', 'volume_size': 1, 'snapshot_id': 'd9f3c51e-2e60-4450-ae9a-e7662b63a383'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cebf39-058e-4757-b4e6-47ac9e6cfca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cebf39-058e-4757-b4e6-47ac9e6cfca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d64e748-6425-48a2-8c1e-f74b06e90b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:07 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Volume c2a4a39b-ed71-4240-9540-b313ca7863eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2a4a39b-ed71-4240-9540-b313ca7863eb', 'volume_size': 1, 'snapshot_id': 'd9f3c51e-2e60-4450-ae9a-e7662b63a383'} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Acquiring lock "cinder-quobyte-d9f3c51e-2e60-4450-ae9a-e7662b63a383-c2a4a39b-ed71-4240-9540-b313ca7863eb" by "_create_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-d9f3c51e-2e60-4450-ae9a-e7662b63a383-c2a4a39b-ed71-4240-9540-b313ca7863eb" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Creating volume c2a4a39b-ed71-4240-9540-b313ca7863eb from snapshot d9f3c51e-2e60-4450-ae9a-e7662b63a383 {{(pid=86659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Acquiring lock "cinder-quobyte-c2a4a39b-ed71-4240-9540-b313ca7863eb" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-c2a4a39b-ed71-4240-9540-b313ca7863eb" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] snapshot: d9f3c51e-2e60-4450-ae9a-e7662b63a383, volume: c2a4a39b-ed71-4240-9540-b313ca7863eb, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a17321d-51e5-4263-9f70-0f932246aea0]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:07 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 Jul 03 16:32:07 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:08 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383" returned: 0 in 1.018s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-297d5e35-a5ca-4f67-889f-8ce2f841db64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:32:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:32:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:32:08 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[081d5da7-b637-44cb-b8cc-6b7f65540e91]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:08 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 Jul 03 16:32:08 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:09 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64" returned: 0 in 0.930s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:09 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb Jul 03 16:32:09 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Flow 'volume_create_manager' (18d183c8-4c60-4c14-8da6-c422e7c1cc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c37a11-c6ed-41ae-a3d9-9238e3945165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c37a11-c6ed-41ae-a3d9-9238e3945165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1185956044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec6e1e3-9c1f-4d15-be51-efe454e949e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d829998f287495cb7b7d101501ccbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:32:10Z,use_quota=True,user_id='778ee11efc724752aeffad79bfe32359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4970638c-abc1-421a-a3d8-ea26c2fc5497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4970638c-abc1-421a-a3d8-ea26c2fc5497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204a1f56-1a94-466e-a9e2-24b9df4561b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:09 devstack cinder-volume[86659]: DEBUG cinder.image.glance [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Creating Keystone auth plugin from conf {{(pid=86659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 16:32:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204a1f56-1a94-466e-a9e2-24b9df4561b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ec6e1e3-9c1f-4d15-be51-efe454e949e1', 'volume_name': 'volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a17b18-0bb4-4964-9082-b682fdc6c2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a17b18-0bb4-4964-9082-b682fdc6c2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8421bd-00aa-4dac-bb88-f1ed6c359c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Volume 9ec6e1e3-9c1f-4d15-be51-efe454e949e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 16:32:10 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Trying to clone 9ec6e1e3-9c1f-4d15-be51-efe454e949e1 from image a5edd4aa-3f97-4644-9685-8001dd3a8cdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]). {{(pid=86659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 16:32:11 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 16:32:11 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Image download 20.69 MB at 20.69 MB/s Jul 03 16:32:11 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb47ed-98a5-49dc-ae76-14cf360b44c2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:11 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD Jul 03 16:32:11 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:13 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD" returned: 0 in 2.347s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:13 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Temporary image a5edd4aa-3f97-4644-9685-8001dd3a8cdd is fetched for user 778ee11efc724752aeffad79bfe32359. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 16:32:13 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8007988-d7b3-4e4b-acd0-936c3eda0ebc]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:14 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD Jul 03 16:32:14 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:16 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb" returned: 0 in 7.009s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:16 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf18215-162c-478a-9bd8-d1e54f2d5b6d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:16 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD" returned: 0 in 2.573s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:32:16 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 Jul 03 16:32:16 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:17 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64" returned: 0 in 1.101s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:17 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:32:17 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Converted 1024.00 MB image at 146.06 MB/s Jul 03 16:32:17 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb is being set with open permissions: ugo+rw Jul 03 16:32:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:17 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb Jul 03 16:32:17 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:18 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb" returned: 0 in 0.751s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-c2a4a39b-ed71-4240-9540-b313ca7863eb" released by "_copy_volume_from_snapshot" :: held 10.971s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-d9f3c51e-2e60-4450-ae9a-e7662b63a383-c2a4a39b-ed71-4240-9540-b313ca7863eb" released by "_create_volume_from_snapshot" :: held 11.017s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.052s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1185956044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec6e1e3-9c1f-4d15-be51-efe454e949e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d829998f287495cb7b7d101501ccbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:32:10Z,use_quota=True,user_id='778ee11efc724752aeffad79bfe32359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Creating volume 9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:32:18 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:18 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 1073741824 Jul 03 16:32:18 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d64e748-6425-48a2-8c1e-f74b06e90b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a4a39b-ed71-4240-9540-b313ca7863eb', 'volume_size': 1, 'snapshot_id': 'd9f3c51e-2e60-4450-ae9a-e7662b63a383'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef584d88-20f9-4e5e-8815-16d550ff2b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Volume volume-c2a4a39b-ed71-4240-9540-b313ca7863eb (c2a4a39b-ed71-4240-9540-b313ca7863eb): created successfully Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef584d88-20f9-4e5e-8815-16d550ff2b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Flow 'volume_create_manager' (d4b54f4a-d597-47e0-8e9a-5f52df65d3d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:32:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-dd4fb57f-24bd-4335-b6c8-019b2aee52a2 tempest-TestStampPattern-2042924185 None] Created volume successfully. Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:32:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:19 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:32:19 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:19 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 1073741824" returned: 0 in 1.087s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:19 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:32:19 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:19 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.734s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:32:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:32:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:32:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:32:20 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 0 in 0.719s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:32:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:32:20 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Attempting download of a5edd4aa-3f97-4644-9685-8001dd3a8cdd ((None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}])) to volume 9ec6e1e3-9c1f-4d15-be51-efe454e949e1. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 16:32:20 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e43d2de-4125-4a86-9e9c-4e41250ec0f8]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_6q8jqsvt {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:20 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_6q8jqsvt Jul 03 16:32:20 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:21 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_6q8jqsvt" returned: 0 in 0.872s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_6q8jqsvt {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:21 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_6q8jqsvt Jul 03 16:32:21 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:22 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_6q8jqsvt" returned: 1 in 0.856s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_6q8jqsvt' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:32:22 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c1019c-db16-4787-9c76-f23356590c9b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:22 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD Jul 03 16:32:22 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:22 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD" returned: 0 in 0.902s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:22 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] a5edd4aa-3f97-4644-9685-8001dd3a8cdd was qcow2, converting to raw {{(pid=86659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 16:32:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:22 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:32:22 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:25 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 0 in 2.760s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:25 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5edd4aa-3f97-4644-9685-8001dd3a8cdd_lm3aletsdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:32:25 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Converted 112.00 MB image at 40.56 MB/s Jul 03 16:32:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:25 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 1G Jul 03 16:32:25 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:26 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 1G" returned: 0 in 1.128s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1979f6-1a8c-4e12-87c5-8b1d8cdf20ca]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:27 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:32:27 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:27 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 0 in 1.009s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:28 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:32:28 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:28 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 1 in 0.947s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:32:28 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Downloaded image a5edd4aa-3f97-4644-9685-8001dd3a8cdd ((None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}])) to volume 9ec6e1e3-9c1f-4d15-be51-efe454e949e1 successfully. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 16:32:28 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Temporary image a5edd4aa-3f97-4644-9685-8001dd3a8cdd for user 778ee11efc724752aeffad79bfe32359 is deleted. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 16:32:28 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Marking volume 9ec6e1e3-9c1f-4d15-be51-efe454e949e1 as bootable. {{(pid=86659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 16:32:28 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Copying metadata from image a5edd4aa-3f97-4644-9685-8001dd3a8cdd to 9ec6e1e3-9c1f-4d15-be51-efe454e949e1. {{(pid=86659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 16:32:28 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Creating volume glance metadata for volume 9ec6e1e3-9c1f-4d15-be51-efe454e949e1 backed by image a5edd4aa-3f97-4644-9685-8001dd3a8cdd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 16:32:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8421bd-00aa-4dac-bb88-f1ed6c359c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1', 'volume_size': 1, 'image_id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd75f60f12be414bbbba801427ff7eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5edd4aa-3f97-4644-9685-8001dd3a8cdd', 'created_at': datetime.datetime(2026, 7, 3, 14, 6, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 6, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5edd4aa-3f97-4644-9685-8001dd3a8cdd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d229ff-dc71-4a23-b92a-879445dea547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:32:29 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Volume volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 (9ec6e1e3-9c1f-4d15-be51-efe454e949e1): created successfully Jul 03 16:32:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d229ff-dc71-4a23-b92a-879445dea547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:32:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Flow 'volume_create_manager' (18d183c8-4c60-4c14-8da6-c422e7c1cc51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:32:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2fa2bde9-7532-4717-bda5-be091fa58e85 tempest-TestShelveInstance-2095717086 None] Created volume successfully. Jul 03 16:32:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:32:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:32:37 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75dc4c2-2dc9-4316-9857-80836378ea47]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:37 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:32:37 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:38 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 0 in 0.861s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:38 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:32:38 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:39 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 1 in 0.796s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:32:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.711s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:32:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42d85842-d2ef-4b4c-bbca-7c4d15c6f829', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:32:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-24553f9b-1cb2-43e1-b859-09ab9c58c238 req-222b43bf-1e8c-4b64-80ef-1c003fb90421 tempest-TestShelveInstance-2095717086 None] attachment_update completed successfully. Jul 03 16:32:49 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=19,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=6 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:32:49 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=16,cinder:INSERT=8,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:32:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-a43609af-3e2a-4c8a-9935-bacb4d8f4108 req-f566705b-42db-4877-92cc-ba27cf29e6e3 tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:32:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-a43609af-3e2a-4c8a-9935-bacb4d8f4108 req-f566705b-42db-4877-92cc-ba27cf29e6e3 tempest-TestStampPattern-2042924185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:32:58 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd10c22-552a-4cfe-9241-d7c0136b5c1c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:32:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-a43609af-3e2a-4c8a-9935-bacb4d8f4108 req-f566705b-42db-4877-92cc-ba27cf29e6e3 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:32:58 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb Jul 03 16:32:58 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:32:59 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 03 16:32:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-a43609af-3e2a-4c8a-9935-bacb4d8f4108 req-f566705b-42db-4877-92cc-ba27cf29e6e3 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb" returned: 0 in 0.928s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:32:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-a43609af-3e2a-4c8a-9935-bacb4d8f4108 req-f566705b-42db-4877-92cc-ba27cf29e6e3 tempest-TestStampPattern-2042924185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.948s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:32:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-a43609af-3e2a-4c8a-9935-bacb4d8f4108 req-f566705b-42db-4877-92cc-ba27cf29e6e3 tempest-TestStampPattern-2042924185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-c2a4a39b-ed71-4240-9540-b313ca7863eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd692354-afe0-42ea-bcbe-65680384c229', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:32:59 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-a43609af-3e2a-4c8a-9935-bacb4d8f4108 req-f566705b-42db-4877-92cc-ba27cf29e6e3 tempest-TestStampPattern-2042924185 None] attachment_update completed successfully. Jul 03 16:33:05 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-5d2a6e95-4f70-4ce5-8552-b965d0ae18a6 req-025965e8-07c9-408d-8e2d-d006402f2b94 tempest-TestStampPattern-2042924185 None] Terminate volume connection completed successfully. Jul 03 16:33:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-5d2a6e95-4f70-4ce5-8552-b965d0ae18a6 req-025965e8-07c9-408d-8e2d-d006402f2b94 tempest-TestStampPattern-2042924185 None] Deleting attachment cd692354-afe0-42ea-bcbe-65680384c229. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:33:15 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:33:15 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:33:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Acquiring lock "cinder-c2a4a39b-ed71-4240-9540-b313ca7863eb-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:33:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Lock "cinder-c2a4a39b-ed71-4240-9540-b313ca7863eb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:33:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Acquiring lock "cinder-quobyte-c2a4a39b-ed71-4240-9540-b313ca7863eb" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:33:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-c2a4a39b-ed71-4240-9540-b313ca7863eb" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:33:16 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2118c6-bdf3-4d7c-a720-b36abf72579e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:33:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:17 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb Jul 03 16:33:17 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:17 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb" returned: 0 in 0.946s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:17 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb Jul 03 16:33:17 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:18 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c2a4a39b-ed71-4240-9540-b313ca7863eb" returned: 0 in 0.821s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-c2a4a39b-ed71-4240-9540-b313ca7863eb" released by "delete_volume" :: held 1.818s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Created reservations ['eebe840b-feff-49cf-921f-6e95409e84f2', '08e8b69e-dc34-4a49-9346-25cab2ec1b89', '3b409f9a-1c4d-4140-8fd6-26202ebc2ba1', '107196cd-ab21-4ffa-ae61-b8344153125c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:18 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:33:18 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:33:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:19 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:33:19 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Acquiring lock "cinder-d9f3c51e-2e60-4450-ae9a-e7662b63a383-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Lock "cinder-d9f3c51e-2e60-4450-ae9a-e7662b63a383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Acquiring lock "cinder-quobyte-297d5e35-a5ca-4f67-889f-8ce2f841db64" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-297d5e35-a5ca-4f67-889f-8ce2f841db64" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Acquiring lock "cinder-quobyte-d9f3c51e-2e60-4450-ae9a-e7662b63a383" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-d9f3c51e-2e60-4450-ae9a-e7662b63a383" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Deleting offline snapshot d9f3c51e-2e60-4450-ae9a-e7662b63a383 of volume 297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] snapshot_file for this snap is: volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abaef7d-6793-4b07-a528-169adeaf3325]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:19 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.999s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:19 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 Jul 03 16:33:19 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:33:19 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Deleted volume successfully. Jul 03 16:33:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cf6f4972-cd8b-441e-b8f3-949b8abc5785 tempest-TestStampPattern-2042924185 None] Lock "cinder-c2a4a39b-ed71-4240-9540-b313ca7863eb-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:33:20 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.030s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:33:20 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-e72daf2a-7c67-4b0f-9d35-2886d97d1b18 req-65ed683c-f427-41cf-bce0-40dfd1629595 tempest-TestShelveInstance-2095717086 None] Terminate volume connection completed successfully. Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-e72daf2a-7c67-4b0f-9d35-2886d97d1b18 req-65ed683c-f427-41cf-bce0-40dfd1629595 tempest-TestShelveInstance-2095717086 None] Deleting attachment 42d85842-d2ef-4b4c-bbca-7c4d15c6f829. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:33:20 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383" returned: 0 in 1.086s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-297d5e35-a5ca-4f67-889f-8ce2f841db64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[40202f97-1c41-448c-85f7-edd422965543]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:33:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:20 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 Jul 03 16:33:20 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:21 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64" returned: 0 in 0.894s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:21 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 Jul 03 16:33:21 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:22 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383" returned: 0 in 0.883s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:22 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383 Jul 03 16:33:22 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:23 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64.d9f3c51e-2e60-4450-ae9a-e7662b63a383" returned: 0 in 0.810s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-d9f3c51e-2e60-4450-ae9a-e7662b63a383" released by "_delete_snapshot" :: held 3.824s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:33:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-297d5e35-a5ca-4f67-889f-8ce2f841db64" released by "delete_snapshot" :: held 3.870s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:33:23 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Created reservations ['72fb0633-19a6-4ddd-a9f9-22e8a9389545', 'b122560a-b9e9-4316-bb3c-aae89e26e24e', '34487a5f-c0d2-43f3-b92e-521341168cf8', '0755947b-6041-426f-a032-ba231e946dc8'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:33:23 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Delete snapshot completed successfully. Jul 03 16:33:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-319d2ce9-b497-4374-8d15-53e228a632e8 tempest-TestStampPattern-2042924185 None] Lock "cinder-d9f3c51e-2e60-4450-ae9a-e7662b63a383-delete_snapshot" released by "delete_snapshot" :: held 4.106s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:33:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c7d0a0-d8d5-4e9e-aa06-dcea059d9a04]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:33:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:26 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:33:26 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:27 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 0 in 1.000s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:27 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:33:27 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:28 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 1 in 0.977s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:33:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.036s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:33:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816', 'name': 'volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '673488db-f49f-4094-8c23-f56e30f840ce', 'enforce_multipath': True} {{(pid=86659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 16:33:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-b2b60839-1cfe-4db8-ac81-1a36a3625788 req-8db950f3-2e15-460a-97ab-52ac087c7bfd tempest-TestShelveInstance-2095717086 None] attachment_update completed successfully. Jul 03 16:33:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Acquiring lock "cinder-297d5e35-a5ca-4f67-889f-8ce2f841db64-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:33:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Lock "cinder-297d5e35-a5ca-4f67-889f-8ce2f841db64-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:33:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Acquiring lock "cinder-quobyte-297d5e35-a5ca-4f67-889f-8ce2f841db64" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:33:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-297d5e35-a5ca-4f67-889f-8ce2f841db64" acquired by "delete_volume" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:33:32 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d48dd1b-fc23-4a85-a92f-c893df33295b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:33:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:32 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 Jul 03 16:33:32 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:33 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64" returned: 0 in 0.893s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:33 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64 Jul 03 16:33:33 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:33 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-297d5e35-a5ca-4f67-889f-8ce2f841db64" returned: 0 in 0.743s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Lock "cinder-quobyte-297d5e35-a5ca-4f67-889f-8ce2f841db64" released by "delete_volume" :: held 1.729s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:33:33 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Created reservations ['879949ee-9445-4825-ace8-3c7c42c0df9b', 'cf4953fc-ae0c-43c9-9177-e802d2239e9a', '204a0ecd-dfee-4a4f-a13a-c741b077d4da', '18c42624-f999-4620-a76d-bee4b3774d55'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:33:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:33:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:33:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:33:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:34 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:33:34 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:34 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.902s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:34 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:33:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Deleted volume successfully. Jul 03 16:33:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4eceb0d9-6eb3-405e-bdb8-e418cf512aa9 tempest-TestStampPattern-2042924185 None] Lock "cinder-297d5e35-a5ca-4f67-889f-8ce2f841db64-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:33:44 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:33:46 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=24,cinder:SELECT=20,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:33:48 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:33:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Flow 'volume_create_manager' (05b7c8b5-95a6-4e5d-8093-2898e3c969e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:33:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec11cbc-32bd-45c9-8e7e-bf216eee680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:48 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec11cbc-32bd-45c9-8e7e-bf216eee680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1065291893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381f2a37-0ad0-4acb-a0e5-955d2f930db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1831c9cd3d4585a2416b94704b6487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:33:49Z,use_quota=True,user_id='42bb38bc575041c1a438a46a949902f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c53605f-6735-4bc7-8bcd-f19e70b3527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c53605f-6735-4bc7-8bcd-f19e70b3527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2239a30f-37a6-441a-ade7-0e3cef41fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2239a30f-37a6-441a-ade7-0e3cef41fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '381f2a37-0ad0-4acb-a0e5-955d2f930db4', 'volume_name': 'volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0480602-9336-4683-9b20-082bf9d2980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0480602-9336-4683-9b20-082bf9d2980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacb74f9-f513-45d3-a135-1c1ff11da56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:49 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Volume 381f2a37-0ad0-4acb-a0e5-955d2f930db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4', 'volume_size': 1} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1065291893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381f2a37-0ad0-4acb-a0e5-955d2f930db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1831c9cd3d4585a2416b94704b6487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:33:49Z,use_quota=True,user_id='42bb38bc575041c1a438a46a949902f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Creating volume 381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:33:49 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:33:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:49 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 1073741824 Jul 03 16:33:49 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:50 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 1073741824" returned: 0 in 1.010s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:50 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 Jul 03 16:33:50 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:50 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4" returned: 0 in 0.712s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:33:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:33:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacb74f9-f513-45d3-a135-1c1ff11da56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eefa7d8-b853-43bd-9bd2-499ca08f2098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:50 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Volume volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 (381f2a37-0ad0-4acb-a0e5-955d2f930db4): created successfully Jul 03 16:33:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eefa7d8-b853-43bd-9bd2-499ca08f2098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:50 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Flow 'volume_create_manager' (05b7c8b5-95a6-4e5d-8093-2898e3c969e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:33:50 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ffe9d365-50c4-459a-9e6d-11f3c38e3853 tempest-VolumeDependencyTests-2133239881 None] Created volume successfully. Jul 03 16:33:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Creating offline snapshot a2dfb313-38df-4227-be8c-850570aeab6c of volume 381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:33:51 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acb1f55-0960-4e20-82d6-920df138f2be]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:33:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:51 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 Jul 03 16:33:51 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:52 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4" returned: 0 in 0.817s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:52 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c 1G Jul 03 16:33:52 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:53 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c 1G" returned: 0 in 0.874s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:53 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c Jul 03 16:33:53 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:53 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c" returned: 0 in 0.779s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:53 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c is being set with open permissions: ugo+rw Jul 03 16:33:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:53 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c Jul 03 16:33:53 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:54 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c" returned: 0 in 0.714s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:54 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.info Jul 03 16:33:54 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:55 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.info" returned: 0 in 0.724s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:55 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.info is being set with open permissions: ugo+rw Jul 03 16:33:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:55 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.info Jul 03 16:33:55 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:56 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.info" returned: 0 in 0.717s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.732s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:33:56 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-99920ad0-d7a0-4cf7-a7ef-f76f3b541814 tempest-VolumeDependencyTests-2133239881 None] Create snapshot completed successfully Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Flow 'volume_create_manager' (d2065133-1de3-43fc-a9c4-6962285e6dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a59ea05-f0aa-4656-905a-bf04ab882889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a59ea05-f0aa-4656-905a-bf04ab882889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-889789803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df895865-6e4f-4ed2-9093-cb40ce799719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1831c9cd3d4585a2416b94704b6487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2dfb313-38df-4227-be8c-850570aeab6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:33:57Z,use_quota=True,user_id='42bb38bc575041c1a438a46a949902f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81a19ea-d53b-46c3-882e-a2bd02e89792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81a19ea-d53b-46c3-882e-a2bd02e89792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c603ad26-3e40-441c-932c-4bc3f135c21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c603ad26-3e40-441c-932c-4bc3f135c21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df895865-6e4f-4ed2-9093-cb40ce799719', 'volume_name': 'volume-df895865-6e4f-4ed2-9093-cb40ce799719', 'volume_size': 1, 'snapshot_id': 'a2dfb313-38df-4227-be8c-850570aeab6c'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e567d321-beb7-499f-85f7-82edb97733ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e567d321-beb7-499f-85f7-82edb97733ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7211d2-e5d3-4958-88f9-d2070eee2186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:33:57 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Volume df895865-6e4f-4ed2-9093-cb40ce799719: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df895865-6e4f-4ed2-9093-cb40ce799719', 'volume_size': 1, 'snapshot_id': 'a2dfb313-38df-4227-be8c-850570aeab6c'} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "cinder-quobyte-a2dfb313-38df-4227-be8c-850570aeab6c-df895865-6e4f-4ed2-9093-cb40ce799719" by "_create_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-a2dfb313-38df-4227-be8c-850570aeab6c-df895865-6e4f-4ed2-9093-cb40ce799719" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Creating volume df895865-6e4f-4ed2-9093-cb40ce799719 from snapshot a2dfb313-38df-4227-be8c-850570aeab6c {{(pid=86659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "cinder-quobyte-df895865-6e4f-4ed2-9093-cb40ce799719" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-df895865-6e4f-4ed2-9093-cb40ce799719" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] snapshot: a2dfb313-38df-4227-be8c-850570aeab6c, volume: df895865-6e4f-4ed2-9093-cb40ce799719, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[60169118-75c1-435e-a92f-c83d8d65d36b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:57 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c Jul 03 16:33:57 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:58 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c" returned: 0 in 0.941s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:33:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:33:58 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:33:58 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d444098-44e8-430c-b697-0bd881a251e5]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:33:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:58 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 Jul 03 16:33:58 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:33:59 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 03 16:33:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4" returned: 0 in 0.814s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:33:59 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:33:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:33:59 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 Jul 03 16:33:59 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:03 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719" returned: 0 in 4.681s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[347cedcd-18cc-4bbb-8f66-cb2bc9bf025f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:04 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 Jul 03 16:34:04 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:05 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4" returned: 0 in 1.077s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:34:05 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Converted 1024.00 MB image at 218.71 MB/s Jul 03 16:34:05 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 is being set with open permissions: ugo+rw Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:05 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 Jul 03 16:34:05 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:05 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719" returned: 0 in 0.732s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-df895865-6e4f-4ed2-9093-cb40ce799719" released by "_copy_volume_from_snapshot" :: held 8.349s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-a2dfb313-38df-4227-be8c-850570aeab6c-df895865-6e4f-4ed2-9093-cb40ce799719" released by "_create_volume_from_snapshot" :: held 8.388s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.412s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7211d2-e5d3-4958-88f9-d2070eee2186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df895865-6e4f-4ed2-9093-cb40ce799719', 'volume_size': 1, 'snapshot_id': 'a2dfb313-38df-4227-be8c-850570aeab6c'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c25d94e-804a-4f88-bb28-d1d12ce984e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:34:05 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Volume volume-df895865-6e4f-4ed2-9093-cb40ce799719 (df895865-6e4f-4ed2-9093-cb40ce799719): created successfully Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c25d94e-804a-4f88-bb28-d1d12ce984e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:34:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Flow 'volume_create_manager' (d2065133-1de3-43fc-a9c4-6962285e6dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:34:05 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-438a38ac-d986-4f73-b6d8-0cb79f749371 tempest-VolumeDependencyTests-2133239881 None] Created volume successfully. Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "cinder-a2dfb313-38df-4227-be8c-850570aeab6c-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-a2dfb313-38df-4227-be8c-850570aeab6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "cinder-quobyte-381f2a37-0ad0-4acb-a0e5-955d2f930db4" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-381f2a37-0ad0-4acb-a0e5-955d2f930db4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "cinder-quobyte-a2dfb313-38df-4227-be8c-850570aeab6c" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-a2dfb313-38df-4227-be8c-850570aeab6c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Deleting offline snapshot a2dfb313-38df-4227-be8c-850570aeab6c of volume 381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] snapshot_file for this snap is: volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc7aeb-8a27-4834-af01-8147cbd0ab86]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:06 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c Jul 03 16:34:06 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:07 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c" returned: 0 in 0.888s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:34:07 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[61264678-4fa9-4fa1-a3c6-c11e68b16cda]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:07 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 Jul 03 16:34:07 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:07 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4" returned: 0 in 0.866s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:07 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c Jul 03 16:34:07 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:08 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c" returned: 0 in 0.808s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:08 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c Jul 03 16:34:08 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:09 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4.a2dfb313-38df-4227-be8c-850570aeab6c" returned: 0 in 0.727s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-a2dfb313-38df-4227-be8c-850570aeab6c" released by "_delete_snapshot" :: held 3.412s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-381f2a37-0ad0-4acb-a0e5-955d2f930db4" released by "delete_snapshot" :: held 3.442s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:09 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Created reservations ['c072354e-26ad-40d8-9c48-287060b3d315', 'fc32dedf-fc71-44cd-87f5-23d191781419', '898c6a08-1a71-4da6-9d5c-401cdb143102', '88e7d89c-5e4e-40db-be91-74d85350cc96'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:34:09 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Delete snapshot completed successfully. Jul 03 16:34:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76ce1a23-fd79-40f6-b25d-d1b7de61ef9b tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-a2dfb313-38df-4227-be8c-850570aeab6c-delete_snapshot" released by "delete_snapshot" :: held 3.597s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "cinder-381f2a37-0ad0-4acb-a0e5-955d2f930db4-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-381f2a37-0ad0-4acb-a0e5-955d2f930db4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "cinder-quobyte-381f2a37-0ad0-4acb-a0e5-955d2f930db4" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-381f2a37-0ad0-4acb-a0e5-955d2f930db4" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:10 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c3757-a952-41f3-b16d-5eceb115860b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:10 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 Jul 03 16:34:10 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:11 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4" returned: 0 in 0.930s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:11 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4 Jul 03 16:34:11 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:12 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-381f2a37-0ad0-4acb-a0e5-955d2f930db4" returned: 0 in 0.793s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-381f2a37-0ad0-4acb-a0e5-955d2f930db4" released by "delete_volume" :: held 1.796s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Created reservations ['c0e28333-ad12-448a-9fda-b1abbbc83e33', '661ad6e9-8d87-4cd5-a2ed-5e854d059e4a', 'b2b5fdfb-fd19-48ef-84ee-878d1457a2d2', 'b7ca90db-91aa-43ee-99d9-6f8e1ebb5ad8'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:12 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:34:12 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "cinder-df895865-6e4f-4ed2-9093-cb40ce799719-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-df895865-6e4f-4ed2-9093-cb40ce799719-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "cinder-quobyte-df895865-6e4f-4ed2-9093-cb40ce799719" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-df895865-6e4f-4ed2-9093-cb40ce799719" acquired by "delete_volume" :: waited 0.030s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4061f7a-c497-4b3e-8286-6bec4fafb66d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:12 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 Jul 03 16:34:12 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:13 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.743s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:13 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:34:13 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Deleted volume successfully. Jul 03 16:34:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-71de8f73-cf11-4ee0-8985-b9459c0b2e82 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-381f2a37-0ad0-4acb-a0e5-955d2f930db4-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:13 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719" returned: 0 in 0.940s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:13 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719 Jul 03 16:34:13 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:14 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-df895865-6e4f-4ed2-9093-cb40ce799719" returned: 0 in 0.760s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-quobyte-df895865-6e4f-4ed2-9093-cb40ce799719" released by "delete_volume" :: held 1.767s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:14 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Created reservations ['68f7bff3-8a3d-4007-a6d9-fb72cafae3ca', '4f7d68f7-a959-43e2-aad1-8e1057941522', '86ac3510-82c5-42ac-99a2-5f66feab97ac', 'f2fbb376-3a89-4c4b-bdc2-5154fbedfb77'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:34:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:34:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:34:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:34:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:34:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:34:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:14 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:34:14 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:15 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.748s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:15 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:34:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Deleted volume successfully. Jul 03 16:34:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-76fef09a-c491-4021-96e2-a3bcaa5cfe85 tempest-VolumeDependencyTests-2133239881 None] Lock "cinder-df895865-6e4f-4ed2-9093-cb40ce799719-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:34:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:34:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:34:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:34:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:34:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:34:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:19 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:34:19 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:19 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.714s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:34:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:34:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:34:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:34:24 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=22,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:34:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-7c360eed-3719-4f18-bb2c-f85dd9a70877 tempest-TestShelveInstance-2095717086 None] Terminate volume connection completed successfully. Jul 03 16:34:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-7c360eed-3719-4f18-bb2c-f85dd9a70877 tempest-TestShelveInstance-2095717086 None] Deleting attachment 673488db-f49f-4094-8c23-f56e30f840ce. {{(pid=86659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 16:34:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Acquiring lock "cinder-9ec6e1e3-9c1f-4d15-be51-efe454e949e1-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Lock "cinder-9ec6e1e3-9c1f-4d15-be51-efe454e949e1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Acquiring lock "cinder-quobyte-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Lock "cinder-quobyte-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d62bedb-d6a7-4c11-a499-8343aa5d3cd9]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:26 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:34:26 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:27 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 0 in 0.841s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:27 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:34:27 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:27 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 1 in 0.869s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:34:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:27 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1 Jul 03 16:34:27 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:28 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" returned: 0 in 0.828s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Lock "cinder-quobyte-9ec6e1e3-9c1f-4d15-be51-efe454e949e1" released by "delete_volume" :: held 2.640s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:28 devstack cinder-volume[86659]: DEBUG cinder.quota [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Created reservations ['4b323f13-16c3-41e6-8ac8-fc398f40aedb', 'd3f112b7-a3b2-4eee-917e-a0889354a9e6', '50d2edf1-c14a-4d6d-9e7a-a143054f551f', '1ebe71d3-7e7a-4791-b721-d97e2047c342'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:34:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:34:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:34:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:34:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:34:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:34:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:29 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:34:29 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:29 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.857s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:29 devstack cinder-volume[86659]: DEBUG cinder.manager [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:34:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Deleted volume successfully. Jul 03 16:34:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [req-f5e28f8e-c44a-44e2-b5b7-619efef4ca1a req-9986b70e-5f8e-40ae-96ae-31bf43d423e9 tempest-TestShelveInstance-2095717086 None] Lock "cinder-9ec6e1e3-9c1f-4d15-be51-efe454e949e1-delete_volume" released by "delete_volume" :: held 3.818s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:34:38 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=31,cinder:UPDATE=34,cinder:DELETE=2,cinder:INSERT=9 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:34:39 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Flow 'volume_create_manager' (52275201-d7e9-40b7-89ff-1cf0b192dc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b734d00-3499-47b8-855f-2f69be236ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b734d00-3499-47b8-855f-2f69be236ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c612a2e-d227-48bf-8ded-6a694bfd0fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2818f6a8b19447ce8fb8ca13d0a1d4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:34:46Z,use_quota=True,user_id='4b541063bd9a442f85f59af59c03a01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26dfe260-666b-4c60-96da-2b47d80b5843),volume_type_id=26dfe260-666b-4c60-96da-2b47d80b5843)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdf93fa-4f39-433d-90d0-0a763942d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdf93fa-4f39-433d-90d0-0a763942d087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3aa362-0343-483f-a239-a0f212eb7460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.image.glance [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Creating Keystone auth plugin from conf {{(pid=86659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3aa362-0343-483f-a239-a0f212eb7460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c612a2e-d227-48bf-8ded-6a694bfd0fb6', 'volume_name': 'volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6', 'volume_size': 1, 'image_id': '25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd953be027226d659d8a78e8a5b361af', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2818f6a8b19447ce8fb8ca13d0a1d4ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '132c07a51aff14058ab37930fa72f49f60a2db310d90ec45d4dae565c31effdc812b6fe5b8b0b2bbed7227c24915a077046ab8842b12bba8c6f76168e763d668', 'id': '25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'created_at': datetime.datetime(2026, 7, 3, 14, 34, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 34, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25daffc7-839d-40a3-af9e-aa2d7f7e7df1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18638c69-ce49-40a9-8c45-255a83b83c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18638c69-ce49-40a9-8c45-255a83b83c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1238053-3b90-413b-859d-909e96493155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:34:46 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Volume 4c612a2e-d227-48bf-8ded-6a694bfd0fb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6', 'volume_size': 1, 'image_id': '25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd953be027226d659d8a78e8a5b361af', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2818f6a8b19447ce8fb8ca13d0a1d4ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '132c07a51aff14058ab37930fa72f49f60a2db310d90ec45d4dae565c31effdc812b6fe5b8b0b2bbed7227c24915a077046ab8842b12bba8c6f76168e763d668', 'id': '25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'created_at': datetime.datetime(2026, 7, 3, 14, 34, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 34, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25daffc7-839d-40a3-af9e-aa2d7f7e7df1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Trying to clone 4c612a2e-d227-48bf-8ded-6a694bfd0fb6 from image 25daffc7-839d-40a3-af9e-aa2d7f7e7df1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'metadata': {}}]). {{(pid=86659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 16:34:46 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Image download 0.00 MB at 0.00 MB/s Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e70da-090c-44f9-bba8-1a65c4dc50c3]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:46 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD Jul 03 16:34:46 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:47 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:47 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD Jul 03 16:34:47 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:48 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD" returned: 1 in 0.760s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:34:48 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Temporary image 25daffc7-839d-40a3-af9e-aa2d7f7e7df1 is fetched for user 4b541063bd9a442f85f59af59c03a01e. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 16:34:48 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0388242f-9c55-40d8-a5e8-90925cc454e1]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:48 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD Jul 03 16:34:48 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:49 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:49 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD Jul 03 16:34:49 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:49 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD" returned: 1 in 0.766s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c612a2e-d227-48bf-8ded-6a694bfd0fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2818f6a8b19447ce8fb8ca13d0a1d4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:34:46Z,use_quota=True,user_id='4b541063bd9a442f85f59af59c03a01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26dfe260-666b-4c60-96da-2b47d80b5843),volume_type_id=26dfe260-666b-4c60-96da-2b47d80b5843)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Creating volume 4c612a2e-d227-48bf-8ded-6a694bfd0fb6 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:34:49 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:34:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:49 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 1073741824 Jul 03 16:34:49 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:50 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 1073741824" returned: 0 in 0.933s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:50 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 Jul 03 16:34:50 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:51 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" returned: 0 in 0.749s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:34:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:34:51 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Attempting download of 25daffc7-839d-40a3-af9e-aa2d7f7e7df1 ((None, [{'url': 'file:///opt/stack/data/glance/images/25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'metadata': {}}])) to volume 4c612a2e-d227-48bf-8ded-6a694bfd0fb6. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 16:34:51 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[120fd35c-f1c1-4265-839b-7aa30458b6cb]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25daffc7-839d-40a3-af9e-aa2d7f7e7df1_x7jv207c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:51 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25daffc7-839d-40a3-af9e-aa2d7f7e7df1_x7jv207c Jul 03 16:34:51 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:52 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25daffc7-839d-40a3-af9e-aa2d7f7e7df1_x7jv207c" returned: 0 in 0.799s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25daffc7-839d-40a3-af9e-aa2d7f7e7df1_x7jv207c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:52 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25daffc7-839d-40a3-af9e-aa2d7f7e7df1_x7jv207c Jul 03 16:34:52 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:53 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25daffc7-839d-40a3-af9e-aa2d7f7e7df1_x7jv207c" returned: 1 in 0.746s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25daffc7-839d-40a3-af9e-aa2d7f7e7df1_x7jv207c' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:34:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ab8edd-45bb-4138-9a0a-70b9ebc7b82c]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:53 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD Jul 03 16:34:53 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:53 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:54 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD Jul 03 16:34:54 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:54 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD" returned: 1 in 0.794s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:34:54 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] 25daffc7-839d-40a3-af9e-aa2d7f7e7df1 was raw, converting to raw {{(pid=86659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 16:34:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:54 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 Jul 03 16:34:54 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:55 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" returned: 0 in 0.841s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:55 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25daffc7-839d-40a3-af9e-aa2d7f7e7df1__t0vdfabdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:34:55 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 16:34:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:55 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 1G Jul 03 16:34:55 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:56 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 1G" returned: 0 in 0.758s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:56 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd324656-7e5a-4796-a838-1a6a9b183282]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:56 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 Jul 03 16:34:56 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:57 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" returned: 0 in 0.823s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:57 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 Jul 03 16:34:57 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:58 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" returned: 1 in 0.835s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Downloaded image 25daffc7-839d-40a3-af9e-aa2d7f7e7df1 ((None, [{'url': 'file:///opt/stack/data/glance/images/25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'metadata': {}}])) to volume 4c612a2e-d227-48bf-8ded-6a694bfd0fb6 successfully. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Temporary image 25daffc7-839d-40a3-af9e-aa2d7f7e7df1 for user 4b541063bd9a442f85f59af59c03a01e is deleted. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Marking volume 4c612a2e-d227-48bf-8ded-6a694bfd0fb6 as bootable. {{(pid=86659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Copying metadata from image 25daffc7-839d-40a3-af9e-aa2d7f7e7df1 to 4c612a2e-d227-48bf-8ded-6a694bfd0fb6. {{(pid=86659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Creating volume glance metadata for volume 4c612a2e-d227-48bf-8ded-6a694bfd0fb6 backed by image 25daffc7-839d-40a3-af9e-aa2d7f7e7df1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fd953be027226d659d8a78e8a5b361af', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1238053-3b90-413b-859d-909e96493155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6', 'volume_size': 1, 'image_id': '25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd953be027226d659d8a78e8a5b361af', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2818f6a8b19447ce8fb8ca13d0a1d4ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '132c07a51aff14058ab37930fa72f49f60a2db310d90ec45d4dae565c31effdc812b6fe5b8b0b2bbed7227c24915a077046ab8842b12bba8c6f76168e763d668', 'id': '25daffc7-839d-40a3-af9e-aa2d7f7e7df1', 'created_at': datetime.datetime(2026, 7, 3, 14, 34, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 34, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25daffc7-839d-40a3-af9e-aa2d7f7e7df1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df38559a-0724-41fe-b840-71adc25247ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:34:58 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Volume volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 (4c612a2e-d227-48bf-8ded-6a694bfd0fb6): created successfully Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df38559a-0724-41fe-b840-71adc25247ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:34:58 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Flow 'volume_create_manager' (52275201-d7e9-40b7-89ff-1cf0b192dc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:34:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-aca5fd94-f815-4f6b-9f88-634168274edd tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Created volume successfully. Jul 03 16:34:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Acquiring lock "cinder-4c612a2e-d227-48bf-8ded-6a694bfd0fb6-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "cinder-4c612a2e-d227-48bf-8ded-6a694bfd0fb6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Acquiring lock "cinder-quobyte-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:34:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "cinder-quobyte-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" acquired by "delete_volume" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:34:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44c8c9c-ab28-48cc-a06b-1ee18edde69e]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:34:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:34:59 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 Jul 03 16:34:59 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:34:59 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 03 16:34:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" returned: 0 in 0.820s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:34:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:00 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 Jul 03 16:35:00 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:00 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" returned: 1 in 0.835s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:35:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:00 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6 Jul 03 16:35:00 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:01 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" returned: 0 in 0.734s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "cinder-quobyte-4c612a2e-d227-48bf-8ded-6a694bfd0fb6" released by "delete_volume" :: held 2.451s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:01 devstack cinder-volume[86659]: WARNING cinder.quota [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:35:01 devstack cinder-volume[86659]: WARNING cinder.quota [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 16:35:01 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Created reservations ['3e0a00cf-9da4-4f8b-9ccc-cf69d52cffb0', '5a385e41-85e1-4539-8911-0c737f67f5e8', '38fff9ea-edce-479b-9a47-c86da782a085', 'e50ed529-b8ba-4a0f-8854-4a3ef22cd1c6'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:01 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:01 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:01 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:02 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.729s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:02 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:02 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Deleted volume successfully. Jul 03 16:35:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-eb30c82d-442c-4367-abdf-20aef73a275f tempest-VolumeAndVolumeTypeFromImageTest-1276301165 None] Lock "cinder-4c612a2e-d227-48bf-8ded-6a694bfd0fb6-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:06 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (46068a4e-d6a5-4ebd-8467-f1b5013c6e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3d0ace-8a97-4a70-a878-a2935b1d2e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3d0ace-8a97-4a70-a878-a2935b1d2e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-746369905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81249adb-a962-40f6-b342-13316cc305d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:07Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41160d3-3e22-4aa5-ace0-6b9e81435b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41160d3-3e22-4aa5-ace0-6b9e81435b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf0d7af-54a8-4ead-9cbf-fee1e04fdc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf0d7af-54a8-4ead-9cbf-fee1e04fdc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81249adb-a962-40f6-b342-13316cc305d3', 'volume_name': 'volume-81249adb-a962-40f6-b342-13316cc305d3', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249ae18c-6f59-4c3d-bc08-8998ddf3d8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249ae18c-6f59-4c3d-bc08-8998ddf3d8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0a395f-a5eb-4087-946c-77964cc77ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:07 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume 81249adb-a962-40f6-b342-13316cc305d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81249adb-a962-40f6-b342-13316cc305d3', 'volume_size': 1} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-746369905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81249adb-a962-40f6-b342-13316cc305d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:07Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Creating volume 81249adb-a962-40f6-b342-13316cc305d3 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:35:07 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:07 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3 1073741824 Jul 03 16:35:07 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:07 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3 1073741824" returned: 0 in 0.908s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:08 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3 Jul 03 16:35:08 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:08 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3" returned: 0 in 0.715s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:35:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0a395f-a5eb-4087-946c-77964cc77ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81249adb-a962-40f6-b342-13316cc305d3', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bccd32-229f-4ed8-ab2b-0b74d8fe8fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:08 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume volume-81249adb-a962-40f6-b342-13316cc305d3 (81249adb-a962-40f6-b342-13316cc305d3): created successfully Jul 03 16:35:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bccd32-229f-4ed8-ab2b-0b74d8fe8fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (46068a4e-d6a5-4ebd-8467-f1b5013c6e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:08 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-508a754d-7e78-4027-b82b-6b769c7a6c1a tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created volume successfully. Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (1fd50f7b-2bad-4630-9edc-04e63b7754da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e9a5dc-e596-4f70-a4bd-b40b17e19616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e9a5dc-e596-4f70-a4bd-b40b17e19616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947312438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825c6d85-f7d3-41c3-84ef-47e7c16650e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:09Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222ce1a9-5d59-4267-a58d-4d0f843007b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222ce1a9-5d59-4267-a58d-4d0f843007b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f34be86-921f-42e0-847a-bff19e6d4295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f34be86-921f-42e0-847a-bff19e6d4295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825c6d85-f7d3-41c3-84ef-47e7c16650e7', 'volume_name': 'volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e793bb5e-0ce4-4504-aba3-00203e4e348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e793bb5e-0ce4-4504-aba3-00203e4e348e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57fe0b8-76ab-4244-a424-0c1a94a4cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:09 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume 825c6d85-f7d3-41c3-84ef-47e7c16650e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7', 'volume_size': 1} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947312438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825c6d85-f7d3-41c3-84ef-47e7c16650e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:09Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Creating volume 825c6d85-f7d3-41c3-84ef-47e7c16650e7 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:35:09 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:09 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 1073741824 Jul 03 16:35:09 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:09 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (0acab85d-0a83-4a2d-9879-9b6dfc24ab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa06a4f0-8b31-4ba1-9bdf-3f3336c3ea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa06a4f0-8b31-4ba1-9bdf-3f3336c3ea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-652256541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd501e5-dea9-4dad-bae2-834f94f10b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:10Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41c4c85-8867-43cf-8dff-c95ae0b154e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41c4c85-8867-43cf-8dff-c95ae0b154e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcebe2ef-199a-4601-a4a1-b5b247ede622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcebe2ef-199a-4601-a4a1-b5b247ede622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd501e5-dea9-4dad-bae2-834f94f10b2e', 'volume_name': 'volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84775b3a-043d-42f8-a9de-2f4716e27ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84775b3a-043d-42f8-a9de-2f4716e27ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f580a9b-1d06-458c-8287-93c8c5121861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume 7bd501e5-dea9-4dad-bae2-834f94f10b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e', 'volume_size': 1} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (3ca01f72-2a12-454e-aba1-bc2103b1a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10a0ec9-ad9a-4e3a-b258-6adda37a448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10a0ec9-ad9a-4e3a-b258-6adda37a448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703137088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d1727b-b763-4d03-813d-880e1f1591bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:10Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2024e59-491a-4fc4-a099-07b99b81ebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2024e59-491a-4fc4-a099-07b99b81ebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe476d5-74e5-4c87-9b0d-1ab3c70c3b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe476d5-74e5-4c87-9b0d-1ab3c70c3b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d1727b-b763-4d03-813d-880e1f1591bc', 'volume_name': 'volume-13d1727b-b763-4d03-813d-880e1f1591bc', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fc31a9-c25b-4674-a059-173abbcf7676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fc31a9-c25b-4674-a059-173abbcf7676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b622e981-4922-45e7-b839-62712b1a9df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume 13d1727b-b763-4d03-813d-880e1f1591bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d1727b-b763-4d03-813d-880e1f1591bc', 'volume_size': 1} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:10 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 1073741824" returned: 0 in 1.063s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:10 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 Jul 03 16:35:10 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (2b2a77f3-39cd-4ed8-8496-cf39be68d772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f80867-7026-4020-a9f5-3f3bc1997715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f80867-7026-4020-a9f5-3f3bc1997715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577755470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3953c162-e975-447a-8c9f-9947d87a66d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:11Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b77d79-17fa-4232-ab58-ebb09a4d62f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b77d79-17fa-4232-ab58-ebb09a4d62f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9368af-ae2a-43ec-9d6b-3ff7171b1693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9368af-ae2a-43ec-9d6b-3ff7171b1693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3953c162-e975-447a-8c9f-9947d87a66d6', 'volume_name': 'volume-3953c162-e975-447a-8c9f-9947d87a66d6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33fe6d9-9d23-4c12-881a-2406fe660db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33fe6d9-9d23-4c12-881a-2406fe660db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7415a859-0b42-4585-a1cc-39b935ea058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume 3953c162-e975-447a-8c9f-9947d87a66d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3953c162-e975-447a-8c9f-9947d87a66d6', 'volume_size': 1} Jul 03 16:35:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (3fac44cc-9061-40b7-adde-fa84e1adc6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d27da1b-361d-42ad-90c5-e13760c79fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d27da1b-361d-42ad-90c5-e13760c79fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-323907506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72b9273-09bf-4233-8d65-bf1bfcac9509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:11Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa805149-1fae-49e3-9792-c6368b6b7713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa805149-1fae-49e3-9792-c6368b6b7713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b29f55-dc0d-4c30-a629-953e2f203877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b29f55-dc0d-4c30-a629-953e2f203877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a72b9273-09bf-4233-8d65-bf1bfcac9509', 'volume_name': 'volume-a72b9273-09bf-4233-8d65-bf1bfcac9509', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b5080b-54ac-4d4c-a27f-2c56c65ea04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b5080b-54ac-4d4c-a27f-2c56c65ea04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d102059-b7ec-4eb4-90ff-1d4e0169aa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:11 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume a72b9273-09bf-4233-8d65-bf1bfcac9509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a72b9273-09bf-4233-8d65-bf1bfcac9509', 'volume_size': 1} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:11 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7" returned: 0 in 0.736s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-652256541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd501e5-dea9-4dad-bae2-834f94f10b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:10Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Creating volume 7bd501e5-dea9-4dad-bae2-834f94f10b2e {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:35:11 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:11 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e 1073741824 Jul 03 16:35:11 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57fe0b8-76ab-4244-a424-0c1a94a4cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19428fdb-1a3f-4f0c-8e75-be86f61bae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:11 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 (825c6d85-f7d3-41c3-84ef-47e7c16650e7): created successfully Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19428fdb-1a3f-4f0c-8e75-be86f61bae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (1fd50f7b-2bad-4630-9edc-04e63b7754da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:11 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f96857e3-cbba-499e-8185-afc4c29471d4 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created volume successfully. Jul 03 16:35:12 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e 1073741824" returned: 0 in 0.873s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:12 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e Jul 03 16:35:12 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:13 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e" returned: 0 in 0.688s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703137088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d1727b-b763-4d03-813d-880e1f1591bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:10Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Creating volume 13d1727b-b763-4d03-813d-880e1f1591bc {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:35:13 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:13 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc 1073741824 Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f580a9b-1d06-458c-8287-93c8c5121861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:13 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc899525-01a0-4c61-93c7-8ab7bf21928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:13 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e (7bd501e5-dea9-4dad-bae2-834f94f10b2e): created successfully Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc899525-01a0-4c61-93c7-8ab7bf21928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (0acab85d-0a83-4a2d-9879-9b6dfc24ab72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:13 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-90fa9388-02b6-4e91-9c6f-b30d8e0f5001 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created volume successfully. Jul 03 16:35:14 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc 1073741824" returned: 0 in 0.902s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:14 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc Jul 03 16:35:14 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:14 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc" returned: 0 in 0.662s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.754s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577755470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3953c162-e975-447a-8c9f-9947d87a66d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:11Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Creating volume 3953c162-e975-447a-8c9f-9947d87a66d6 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:35:14 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:14 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6 1073741824 Jul 03 16:35:14 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b622e981-4922-45e7-b839-62712b1a9df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d1727b-b763-4d03-813d-880e1f1591bc', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad26788-fbbf-4048-9f62-30e75c2afd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:14 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume volume-13d1727b-b763-4d03-813d-880e1f1591bc (13d1727b-b763-4d03-813d-880e1f1591bc): created successfully Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad26788-fbbf-4048-9f62-30e75c2afd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (3ca01f72-2a12-454e-aba1-bc2103b1a971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1e5fc543-d77d-47cb-b84a-190b299fe0cd tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created volume successfully. Jul 03 16:35:15 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6 1073741824" returned: 0 in 0.996s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:15 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6 Jul 03 16:35:15 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:16 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6" returned: 0 in 0.723s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.132s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-323907506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72b9273-09bf-4233-8d65-bf1bfcac9509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9bb3ce37114499a1b72df4bacd6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:11Z,use_quota=True,user_id='10d40e2c169b4af4b32d17c5c4e35d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Creating volume a72b9273-09bf-4233-8d65-bf1bfcac9509 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:35:16 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:16 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 1073741824 Jul 03 16:35:16 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7415a859-0b42-4585-a1cc-39b935ea058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3953c162-e975-447a-8c9f-9947d87a66d6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0778db53-463e-4c56-8ae4-1e3acc12aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:16 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume volume-3953c162-e975-447a-8c9f-9947d87a66d6 (3953c162-e975-447a-8c9f-9947d87a66d6): created successfully Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0778db53-463e-4c56-8ae4-1e3acc12aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (2b2a77f3-39cd-4ed8-8496-cf39be68d772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:16 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7124dc01-d7d1-4234-8891-fc1c9bd1aa92 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created volume successfully. Jul 03 16:35:17 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 1073741824" returned: 0 in 0.903s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:17 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 Jul 03 16:35:17 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:18 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509" returned: 0 in 0.699s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d102059-b7ec-4eb4-90ff-1d4e0169aa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a72b9273-09bf-4233-8d65-bf1bfcac9509', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5976820f-f78a-4991-99ff-715d5dbe01d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Volume volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 (a72b9273-09bf-4233-8d65-bf1bfcac9509): created successfully Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5976820f-f78a-4991-99ff-715d5dbe01d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Flow 'volume_create_manager' (3fac44cc-9061-40b7-adde-fa84e1adc6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-226756d3-8596-4ce6-b4a4-10e08ff0ba72 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created volume successfully. Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-a72b9273-09bf-4233-8d65-bf1bfcac9509-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:19 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:19 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-a72b9273-09bf-4233-8d65-bf1bfcac9509-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-quobyte-a72b9273-09bf-4233-8d65-bf1bfcac9509" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-a72b9273-09bf-4233-8d65-bf1bfcac9509" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c360a452-9830-446f-8e5f-4c451a37559a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:19 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 Jul 03 16:35:19 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:19 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.747s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:35:19 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509" returned: 0 in 0.817s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:19 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509 Jul 03 16:35:19 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:20 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a72b9273-09bf-4233-8d65-bf1bfcac9509" returned: 0 in 0.659s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-a72b9273-09bf-4233-8d65-bf1bfcac9509" released by "delete_volume" :: held 1.521s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:20 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created reservations ['9f24ec32-90fe-4be4-abcf-c15da657d79b', '8d309916-c56b-43a5-b019-cc185b573686', 'c39e5cfc-c657-4335-9a1e-f5b7578974ed', 'e48baaff-2bd2-4a35-86e9-4bc88cc48165'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:20 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:20 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:20 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-3953c162-e975-447a-8c9f-9947d87a66d6-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-3953c162-e975-447a-8c9f-9947d87a66d6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-quobyte-3953c162-e975-447a-8c9f-9947d87a66d6" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-3953c162-e975-447a-8c9f-9947d87a66d6" acquired by "delete_volume" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:21 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f4cc65-a685-42cc-beb2-392c00894e17]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:21 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.736s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:21 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Deleted volume successfully. Jul 03 16:35:21 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6 Jul 03 16:35:21 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-558cd7f4-2fe1-49ed-81bd-7f4ee19eb303 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-a72b9273-09bf-4233-8d65-bf1bfcac9509-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:22 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6" returned: 0 in 0.808s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:22 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6 Jul 03 16:35:22 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:22 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3953c162-e975-447a-8c9f-9947d87a66d6" returned: 0 in 0.646s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-3953c162-e975-447a-8c9f-9947d87a66d6" released by "delete_volume" :: held 1.502s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created reservations ['6d73e8be-7080-4a52-adf0-79fdfd8b10a6', '9e265710-42f2-41a5-a0b8-c61a3ce4066a', '6252862e-a818-487b-a176-08559402891d', '7214e79e-8d33-48b9-b86a-1efc181e3836'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:22 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:22 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-13d1727b-b763-4d03-813d-880e1f1591bc-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-13d1727b-b763-4d03-813d-880e1f1591bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-quobyte-13d1727b-b763-4d03-813d-880e1f1591bc" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:23 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.652s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:23 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-13d1727b-b763-4d03-813d-880e1f1591bc" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:23 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Deleted volume successfully. Jul 03 16:35:23 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6fad14-3b15-45d8-8c91-d13cc7797c00]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-106d927d-4529-44ee-945f-4623f3d11c8b tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-3953c162-e975-447a-8c9f-9947d87a66d6-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:23 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc Jul 03 16:35:23 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:24 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc" returned: 0 in 0.819s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:24 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc Jul 03 16:35:24 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:25 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-13d1727b-b763-4d03-813d-880e1f1591bc" returned: 0 in 0.707s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-13d1727b-b763-4d03-813d-880e1f1591bc" released by "delete_volume" :: held 1.577s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created reservations ['51db261c-9e15-4621-9de9-8903f971ffa9', 'e716ed24-82e5-4360-8667-d71db3c7fce1', '83fde75d-c21b-4e0c-9d86-24a9786a0d26', 'e4005edb-d6be-46b0-9a2e-8daffa5b7a3a'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:25 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:25 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-7bd501e5-dea9-4dad-bae2-834f94f10b2e-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-7bd501e5-dea9-4dad-bae2-834f94f10b2e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-quobyte-7bd501e5-dea9-4dad-bae2-834f94f10b2e" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-7bd501e5-dea9-4dad-bae2-834f94f10b2e" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed533fa-92ee-4aff-9302-04f55dfc7c0f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:26 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e Jul 03 16:35:26 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:26 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.701s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:26 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:26 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Deleted volume successfully. Jul 03 16:35:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-db8e5b4c-7330-42c1-80d1-23223aec2033 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-13d1727b-b763-4d03-813d-880e1f1591bc-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:26 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e" returned: 0 in 0.815s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:26 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e Jul 03 16:35:26 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:27 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7bd501e5-dea9-4dad-bae2-834f94f10b2e" returned: 0 in 0.707s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:27 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-7bd501e5-dea9-4dad-bae2-834f94f10b2e" released by "delete_volume" :: held 1.571s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:27 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created reservations ['a25c9f9a-598b-4840-a983-a56ea0172e12', '41ebf860-4ef4-47e6-9bc1-be27fea0d954', 'ee9873bf-e3b9-46f6-9ad7-fba3c0932f6c', '0d3f8a63-4a3d-4cf7-80e6-30ea7a6db51e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:27 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:27 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-825c6d85-f7d3-41c3-84ef-47e7c16650e7-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-825c6d85-f7d3-41c3-84ef-47e7c16650e7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-quobyte-825c6d85-f7d3-41c3-84ef-47e7c16650e7" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-825c6d85-f7d3-41c3-84ef-47e7c16650e7" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[978e45d5-09c4-40fc-9b28-ed0c230e84bd]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:28 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.691s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:28 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Deleted volume successfully. Jul 03 16:35:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d3bc261f-d77c-4c6b-9851-081b26455ebf tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-7bd501e5-dea9-4dad-bae2-834f94f10b2e-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:28 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 Jul 03 16:35:28 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:28 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7" returned: 0 in 0.804s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:29 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7 Jul 03 16:35:29 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:29 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-825c6d85-f7d3-41c3-84ef-47e7c16650e7" returned: 0 in 0.668s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-825c6d85-f7d3-41c3-84ef-47e7c16650e7" released by "delete_volume" :: held 1.532s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created reservations ['d9417402-8c83-4cf7-b805-ca164b83e13c', 'd27df8e0-a431-4199-9190-1c64c1298b98', 'b99c4f65-8a5d-4be0-9635-5f2d2b7cb031', '9f54ca92-6a95-4b87-96ec-c97aeb17d8e9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:29 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:29 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-81249adb-a962-40f6-b342-13316cc305d3-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-81249adb-a962-40f6-b342-13316cc305d3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "cinder-quobyte-81249adb-a962-40f6-b342-13316cc305d3" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-81249adb-a962-40f6-b342-13316cc305d3" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:30 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98310a9-a08e-4d95-96ea-60228c866790]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:30 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3 Jul 03 16:35:30 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:30 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.830s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:30 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:30 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Deleted volume successfully. Jul 03 16:35:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-20c3a6ae-199c-42a0-baa8-633a980d19bb tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-825c6d85-f7d3-41c3-84ef-47e7c16650e7-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:31 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3" returned: 0 in 0.832s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:31 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3 Jul 03 16:35:31 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:32 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-81249adb-a962-40f6-b342-13316cc305d3" returned: 0 in 0.744s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-quobyte-81249adb-a962-40f6-b342-13316cc305d3" released by "delete_volume" :: held 1.620s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Created reservations ['6a325dcd-21b6-4bc5-ae42-f2b08adcbc85', 'e8c3b6f4-7019-4480-91be-b15db26379bb', '26071004-4e5f-47eb-b779-70da13d70570', '062e6d4f-18db-4edb-a4c3-4da9dcbe4032'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:32 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:32 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:32 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.783s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:32 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Deleted volume successfully. Jul 03 16:35:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3ead0a17-e417-4ef0-85ed-f0630580f3d2 tempest-CreateVolumesFromSourceVolumeTest-599904589 None] Lock "cinder-81249adb-a962-40f6-b342-13316cc305d3-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Flow 'volume_create_manager' (1488a436-e49b-4031-8d5a-6779998a2eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c829fdb-8a4c-44ba-b253-99ebe66181af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c829fdb-8a4c-44ba-b253-99ebe66181af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2002dbf7-d81a-44c6-a8e1-5b83c14010fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b8dfa757ea4ca889c76d9cf117073c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:36Z,use_quota=True,user_id='435dcf242c48476e95ff51920e7a26a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb12bd4-368e-43a8-89bf-0bdd9c6691d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb12bd4-368e-43a8-89bf-0bdd9c6691d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9d1fa7-d7c3-4780-afcb-3e1af5b8b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9d1fa7-d7c3-4780-afcb-3e1af5b8b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2002dbf7-d81a-44c6-a8e1-5b83c14010fd', 'volume_name': 'volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a61c8c-0ae2-4572-96f9-fdfcd85ee056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a61c8c-0ae2-4572-96f9-fdfcd85ee056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f7b49f-f4b3-49b7-a7f4-37fe49e1f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:36 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Volume 2002dbf7-d81a-44c6-a8e1-5b83c14010fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd', 'volume_size': 1} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2002dbf7-d81a-44c6-a8e1-5b83c14010fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b8dfa757ea4ca889c76d9cf117073c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:36Z,use_quota=True,user_id='435dcf242c48476e95ff51920e7a26a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Creating volume 2002dbf7-d81a-44c6-a8e1-5b83c14010fd {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:35:36 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:35:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:36 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd 1073741824 Jul 03 16:35:36 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:37 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd 1073741824" returned: 0 in 0.982s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:37 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd Jul 03 16:35:37 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:37 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd" returned: 0 in 0.698s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:35:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f7b49f-f4b3-49b7-a7f4-37fe49e1f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d236e2c-a555-4d87-b44d-c94fcd8f890d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Volume volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd (2002dbf7-d81a-44c6-a8e1-5b83c14010fd): created successfully Jul 03 16:35:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d236e2c-a555-4d87-b44d-c94fcd8f890d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Flow 'volume_create_manager' (1488a436-e49b-4031-8d5a-6779998a2eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b374ac49-724c-49d7-804f-5a9fc52f2107 tempest-CinderUnicodeTest-1614957984 None] Created volume successfully. Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Flow 'volume_create_manager' (1220a0eb-3485-4c15-9100-b958931fc6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367f7475-34c4-4962-8c2c-d78e5d0cda95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367f7475-34c4-4962-8c2c-d78e5d0cda95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1038782588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c255a8-f5a7-4773-a810-b12c4007a20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b8dfa757ea4ca889c76d9cf117073c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:39Z,use_quota=True,user_id='435dcf242c48476e95ff51920e7a26a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de22659-2e31-4114-9882-0c56ba6f17d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de22659-2e31-4114-9882-0c56ba6f17d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b55607-4bad-4e54-9eb2-5e694ea82084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b55607-4bad-4e54-9eb2-5e694ea82084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c255a8-f5a7-4773-a810-b12c4007a20c', 'volume_name': 'volume-e3c255a8-f5a7-4773-a810-b12c4007a20c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf79b99-8338-4922-b002-389b9d74950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf79b99-8338-4922-b002-389b9d74950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388c0e46-0330-42d3-91b4-dd1473039223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Volume e3c255a8-f5a7-4773-a810-b12c4007a20c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c255a8-f5a7-4773-a810-b12c4007a20c', 'volume_size': 1} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1038782588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c255a8-f5a7-4773-a810-b12c4007a20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b8dfa757ea4ca889c76d9cf117073c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:39Z,use_quota=True,user_id='435dcf242c48476e95ff51920e7a26a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Creating volume e3c255a8-f5a7-4773-a810-b12c4007a20c {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:35:38 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:35:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:38 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c 1073741824 Jul 03 16:35:38 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:39 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c 1073741824" returned: 0 in 0.958s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:39 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=86,cinder:SELECT=56,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:35:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:39 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c Jul 03 16:35:39 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:40 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c" returned: 0 in 0.818s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:35:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:40 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=63,cinder:INSERT=20,cinder:UPDATE=82,cinder:DELETE=7 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:35:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388c0e46-0330-42d3-91b4-dd1473039223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c255a8-f5a7-4773-a810-b12c4007a20c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66af0f0a-47a5-4525-863e-b9692ce2afa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:40 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Volume volume-e3c255a8-f5a7-4773-a810-b12c4007a20c (e3c255a8-f5a7-4773-a810-b12c4007a20c): created successfully Jul 03 16:35:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66af0f0a-47a5-4525-863e-b9692ce2afa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Flow 'volume_create_manager' (1220a0eb-3485-4c15-9100-b958931fc6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:40 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6366a0b5-49b3-4fec-b446-69238feb1796 tempest-CinderUnicodeTest-1614957984 None] Created volume successfully. Jul 03 16:35:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Creating offline snapshot b6407eb2-5d74-4239-b40d-d7576379a6b1 of volume e3c255a8-f5a7-4773-a810-b12c4007a20c {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:35:41 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fc751b-176d-492e-b412-45defc70ddf2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:41 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c Jul 03 16:35:41 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:41 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c" returned: 0 in 0.778s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:41 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 1G Jul 03 16:35:41 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:42 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 1G" returned: 0 in 0.899s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c255a8-f5a7-4773-a810-b12c4007a20c -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:42 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c255a8-f5a7-4773-a810-b12c4007a20c -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 Jul 03 16:35:42 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:43 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3c255a8-f5a7-4773-a810-b12c4007a20c -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1" returned: 0 in 0.750s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:43 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 is being set with open permissions: ugo+rw Jul 03 16:35:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:43 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 Jul 03 16:35:43 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:44 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1" returned: 0 in 0.784s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:44 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.info Jul 03 16:35:44 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:45 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.info" returned: 0 in 0.791s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:45 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.info is being set with open permissions: ugo+rw Jul 03 16:35:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:45 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.info Jul 03 16:35:45 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:45 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.info" returned: 0 in 0.748s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.877s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:45 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-22381009-68f1-4220-b3e8-b16593b54c0f tempest-CinderUnicodeTest-1614957984 None] Create snapshot completed successfully Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "cinder-b6407eb2-5d74-4239-b40d-d7576379a6b1-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-b6407eb2-5d74-4239-b40d-d7576379a6b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "cinder-quobyte-e3c255a8-f5a7-4773-a810-b12c4007a20c" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-quobyte-e3c255a8-f5a7-4773-a810-b12c4007a20c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "cinder-quobyte-b6407eb2-5d74-4239-b40d-d7576379a6b1" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-quobyte-b6407eb2-5d74-4239-b40d-d7576379a6b1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Deleting offline snapshot b6407eb2-5d74-4239-b40d-d7576379a6b1 of volume e3c255a8-f5a7-4773-a810-b12c4007a20c {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] snapshot_file for this snap is: volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e73e11-6864-4966-aa08-7705b587dcda]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:46 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 Jul 03 16:35:46 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:47 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1" returned: 0 in 0.791s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3c255a8-f5a7-4773-a810-b12c4007a20c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:35:47 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf75d11-1df0-4945-9301-576acf666614]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:47 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c Jul 03 16:35:47 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:48 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c" returned: 0 in 0.779s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:48 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 Jul 03 16:35:48 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:48 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1" returned: 0 in 0.741s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:48 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1 Jul 03 16:35:48 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:49 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c.b6407eb2-5d74-4239-b40d-d7576379a6b1" returned: 0 in 0.749s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-quobyte-b6407eb2-5d74-4239-b40d-d7576379a6b1" released by "_delete_snapshot" :: held 3.192s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-quobyte-e3c255a8-f5a7-4773-a810-b12c4007a20c" released by "delete_snapshot" :: held 3.224s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:49 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Created reservations ['f3974ba5-271f-4994-bb97-3f58f1cddee7', 'b605c44f-7d89-4eb2-81d8-27bc805c15ad', '0100f1a5-b69b-4298-8853-7ea310f6de52', 'c5b7e0d4-d175-49b5-b675-49c65de4ca21'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Delete snapshot completed successfully. Jul 03 16:35:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cfd4e2ce-d3d9-4605-9ba5-0dfb9a271929 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-b6407eb2-5d74-4239-b40d-d7576379a6b1-delete_snapshot" released by "delete_snapshot" :: held 3.396s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "cinder-e3c255a8-f5a7-4773-a810-b12c4007a20c-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-e3c255a8-f5a7-4773-a810-b12c4007a20c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "cinder-quobyte-e3c255a8-f5a7-4773-a810-b12c4007a20c" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-quobyte-e3c255a8-f5a7-4773-a810-b12c4007a20c" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bef891-a83e-43eb-bcae-6f41494116c9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:50 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c Jul 03 16:35:50 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:51 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c" returned: 0 in 0.902s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:51 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c Jul 03 16:35:51 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:52 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e3c255a8-f5a7-4773-a810-b12c4007a20c" returned: 0 in 0.715s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-quobyte-e3c255a8-f5a7-4773-a810-b12c4007a20c" released by "delete_volume" :: held 1.681s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Created reservations ['323e35a7-6439-4ee5-b44a-2f325b02988e', 'b40d4661-d521-40b6-be20-bd71da7a3c7b', '26dee3cc-ef42-43f7-b84a-45ac0f434155', '5f48e9fe-6f99-4b79-b977-0f9a1410a96d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:52 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:52 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "cinder-2002dbf7-d81a-44c6-a8e1-5b83c14010fd-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-2002dbf7-d81a-44c6-a8e1-5b83c14010fd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "cinder-quobyte-2002dbf7-d81a-44c6-a8e1-5b83c14010fd" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:35:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-quobyte-2002dbf7-d81a-44c6-a8e1-5b83c14010fd" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:35:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[56295355-da26-4313-9708-8d50cdf1122a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:35:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:53 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd Jul 03 16:35:53 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:53 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.696s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:53 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Deleted volume successfully. Jul 03 16:35:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2f8e2e17-7725-4140-ae55-3e6c553180c5 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-e3c255a8-f5a7-4773-a810-b12c4007a20c-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:53 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd" returned: 0 in 0.852s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:53 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd Jul 03 16:35:53 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:54 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2002dbf7-d81a-44c6-a8e1-5b83c14010fd" returned: 0 in 0.700s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-quobyte-2002dbf7-d81a-44c6-a8e1-5b83c14010fd" released by "delete_volume" :: held 1.599s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:54 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Created reservations ['4f631cf2-4c3a-4dc9-96b8-b2c3b2fe2f9b', 'c8e4c335-26d4-4c53-8cc7-fa9f2c3d400d', 'd9202e3c-f60a-4d59-912d-3e8c3bc051ba', '8d4f0655-afd9-430a-83b4-093a481e927c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:35:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:54 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:35:54 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:35:55 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 03 16:35:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.771s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:35:55 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:35:55 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Deleted volume successfully. Jul 03 16:35:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-baf49dcc-7df7-4fc4-ab4e-b320b3345b24 tempest-CinderUnicodeTest-1614957984 None] Lock "cinder-2002dbf7-d81a-44c6-a8e1-5b83c14010fd-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Flow 'volume_create_manager' (de00ba03-3739-4c7b-b23b-b9034d281084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc82b0c-9b42-488a-84e4-70fa9eb55670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc82b0c-9b42-488a-84e4-70fa9eb55670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-27384407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9bb012-bb98-455c-aad5-740cefb7e450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6222187fb1d4664bda31390dc76417f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:59Z,use_quota=True,user_id='2a7b9e7f37b74ce7b25bc4acf9794543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe19ea0-49a8-496c-84a0-8ef5af8a3458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe19ea0-49a8-496c-84a0-8ef5af8a3458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688def69-fe50-400e-93d0-61ffa0251d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688def69-fe50-400e-93d0-61ffa0251d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9bb012-bb98-455c-aad5-740cefb7e450', 'volume_name': 'volume-cd9bb012-bb98-455c-aad5-740cefb7e450', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2652bb22-a7bd-4ae5-a667-9f617b694631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2652bb22-a7bd-4ae5-a667-9f617b694631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194c15b9-c6ab-4d5d-bc8d-d3e8260f8db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:35:59 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Volume cd9bb012-bb98-455c-aad5-740cefb7e450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9bb012-bb98-455c-aad5-740cefb7e450', 'volume_size': 1} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-27384407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9bb012-bb98-455c-aad5-740cefb7e450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6222187fb1d4664bda31390dc76417f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:35:59Z,use_quota=True,user_id='2a7b9e7f37b74ce7b25bc4acf9794543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Creating volume cd9bb012-bb98-455c-aad5-740cefb7e450 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:35:59 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:35:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:35:59 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450 1073741824 Jul 03 16:35:59 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:00 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450 1073741824" returned: 0 in 0.919s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:00 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450 Jul 03 16:36:00 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:00 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450" returned: 0 in 0.708s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194c15b9-c6ab-4d5d-bc8d-d3e8260f8db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9bb012-bb98-455c-aad5-740cefb7e450', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bbb49b-31e6-43ad-a60b-bfdca8d57723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:00 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Volume volume-cd9bb012-bb98-455c-aad5-740cefb7e450 (cd9bb012-bb98-455c-aad5-740cefb7e450): created successfully Jul 03 16:36:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bbb49b-31e6-43ad-a60b-bfdca8d57723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:00 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Flow 'volume_create_manager' (de00ba03-3739-4c7b-b23b-b9034d281084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:00 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ab938c01-96ff-49a2-b5a7-dd897c4ca857 tempest-ProjectReaderTests-714539673 None] Created volume successfully. Jul 03 16:36:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Acquiring lock "cinder-cd9bb012-bb98-455c-aad5-740cefb7e450-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Lock "cinder-cd9bb012-bb98-455c-aad5-740cefb7e450-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Acquiring lock "cinder-quobyte-cd9bb012-bb98-455c-aad5-740cefb7e450" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Lock "cinder-quobyte-cd9bb012-bb98-455c-aad5-740cefb7e450" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c20a6c7-d497-4521-a29a-a5ba253ddf86]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:01 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450 Jul 03 16:36:01 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:02 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450" returned: 0 in 0.773s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:02 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450 Jul 03 16:36:02 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:02 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-cd9bb012-bb98-455c-aad5-740cefb7e450" returned: 0 in 0.664s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Lock "cinder-quobyte-cd9bb012-bb98-455c-aad5-740cefb7e450" released by "delete_volume" :: held 1.476s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Created reservations ['de129314-35aa-49ed-834d-c9aa763408ce', '6b64c05c-6e1c-419f-9556-7d2982ca729a', '34ce6779-0a66-4005-9c88-c3b62a1f8df3', 'f8436e73-cefd-48bb-ac69-f13e7bc733a2'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:03 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:03 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:03 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.698s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:03 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Deleted volume successfully. Jul 03 16:36:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b86e515e-7796-45b5-964a-082f12d0fd32 tempest-ProjectReaderTests-714539673 None] Lock "cinder-cd9bb012-bb98-455c-aad5-740cefb7e450-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Flow 'volume_create_manager' (a3fdda6c-a8b7-4023-831c-5fb23ddf1ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba5fe8f-8ecd-4970-bb3d-778b047f030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba5fe8f-8ecd-4970-bb3d-778b047f030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1800199414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6caf8a3-93a9-4506-98b8-5afa8a4405d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6222187fb1d4664bda31390dc76417f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:04Z,use_quota=True,user_id='2a7b9e7f37b74ce7b25bc4acf9794543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17827798-4959-4e34-85fb-c6a0de270748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17827798-4959-4e34-85fb-c6a0de270748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b3cc9d-e249-4d8e-b573-15958f165eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b3cc9d-e249-4d8e-b573-15958f165eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6caf8a3-93a9-4506-98b8-5afa8a4405d9', 'volume_name': 'volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07e1f25-fe69-404b-9512-fc5c9ceda4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07e1f25-fe69-404b-9512-fc5c9ceda4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a50eb65-ee85-4589-9992-36b9db469d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:04 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Volume e6caf8a3-93a9-4506-98b8-5afa8a4405d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9', 'volume_size': 1} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1800199414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6caf8a3-93a9-4506-98b8-5afa8a4405d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6222187fb1d4664bda31390dc76417f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:04Z,use_quota=True,user_id='2a7b9e7f37b74ce7b25bc4acf9794543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Creating volume e6caf8a3-93a9-4506-98b8-5afa8a4405d9 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:04 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:04 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 1073741824 Jul 03 16:36:04 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:05 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 1073741824" returned: 0 in 0.899s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:05 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 Jul 03 16:36:05 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:05 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9" returned: 0 in 0.636s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a50eb65-ee85-4589-9992-36b9db469d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc67908-37ea-456b-8d97-bc82a45b0889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:05 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Volume volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 (e6caf8a3-93a9-4506-98b8-5afa8a4405d9): created successfully Jul 03 16:36:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc67908-37ea-456b-8d97-bc82a45b0889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:05 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Flow 'volume_create_manager' (a3fdda6c-a8b7-4023-831c-5fb23ddf1ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:05 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e5f862b0-fd7c-4ac6-bc9a-0aef9a570639 tempest-ProjectReaderTests-714539673 None] Created volume successfully. Jul 03 16:36:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Acquiring lock "cinder-e6caf8a3-93a9-4506-98b8-5afa8a4405d9-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Lock "cinder-e6caf8a3-93a9-4506-98b8-5afa8a4405d9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Acquiring lock "cinder-quobyte-e6caf8a3-93a9-4506-98b8-5afa8a4405d9" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Lock "cinder-quobyte-e6caf8a3-93a9-4506-98b8-5afa8a4405d9" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:06 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ad4698-af1b-4509-b4c5-987a215bc32b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:06 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 Jul 03 16:36:06 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:07 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9" returned: 0 in 0.796s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:07 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9 Jul 03 16:36:07 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:07 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e6caf8a3-93a9-4506-98b8-5afa8a4405d9" returned: 0 in 0.694s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Lock "cinder-quobyte-e6caf8a3-93a9-4506-98b8-5afa8a4405d9" released by "delete_volume" :: held 1.530s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Created reservations ['e16dd0ab-6067-4d76-823c-382e78f87de8', '010f73c0-fc84-4aec-8862-9df1e00f74ba', '85d7e238-854f-4c2c-84d8-41b05c715646', '170acffa-58dc-44ae-a24f-4c959e44d0ab'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:07 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:07 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:08 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.729s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:08 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Deleted volume successfully. Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac6c60e4-534f-42bc-a069-47feb3d774fc tempest-ProjectReaderTests-714539673 None] Lock "cinder-e6caf8a3-93a9-4506-98b8-5afa8a4405d9-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Flow 'volume_create_manager' (1597e475-f1cc-4bc9-91e1-93217637f3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d7651e-c574-4e40-a570-0ed315f92e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d7651e-c574-4e40-a570-0ed315f92e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13882431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb38fad-765e-4848-bfa0-168fcffb34ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6222187fb1d4664bda31390dc76417f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:09Z,use_quota=True,user_id='2a7b9e7f37b74ce7b25bc4acf9794543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fd6891-0c51-4e16-8294-0db63a625853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fd6891-0c51-4e16-8294-0db63a625853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7744b5e8-62c7-43b3-8b16-4e8ae401b193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7744b5e8-62c7-43b3-8b16-4e8ae401b193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb38fad-765e-4848-bfa0-168fcffb34ee', 'volume_name': 'volume-2cb38fad-765e-4848-bfa0-168fcffb34ee', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480a0a53-2050-4dfb-9edf-d21bead13bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480a0a53-2050-4dfb-9edf-d21bead13bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc73bdd-4c63-4a6e-a00e-29ac406d409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:08 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Volume 2cb38fad-765e-4848-bfa0-168fcffb34ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb38fad-765e-4848-bfa0-168fcffb34ee', 'volume_size': 1} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13882431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb38fad-765e-4848-bfa0-168fcffb34ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6222187fb1d4664bda31390dc76417f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:09Z,use_quota=True,user_id='2a7b9e7f37b74ce7b25bc4acf9794543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Creating volume 2cb38fad-765e-4848-bfa0-168fcffb34ee {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:08 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:09 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee 1073741824 Jul 03 16:36:09 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:09 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee 1073741824" returned: 0 in 0.877s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:09 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee Jul 03 16:36:09 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:10 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee" returned: 0 in 0.676s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc73bdd-4c63-4a6e-a00e-29ac406d409e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb38fad-765e-4848-bfa0-168fcffb34ee', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1858c688-c1c9-4fd5-a315-01e9e1a09c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Volume volume-2cb38fad-765e-4848-bfa0-168fcffb34ee (2cb38fad-765e-4848-bfa0-168fcffb34ee): created successfully Jul 03 16:36:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1858c688-c1c9-4fd5-a315-01e9e1a09c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Flow 'volume_create_manager' (1597e475-f1cc-4bc9-91e1-93217637f3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:10 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-268e1c37-7377-4ae7-8d31-c1275f650240 tempest-ProjectReaderTests-714539673 None] Created volume successfully. Jul 03 16:36:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Acquiring lock "cinder-2cb38fad-765e-4848-bfa0-168fcffb34ee-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Lock "cinder-2cb38fad-765e-4848-bfa0-168fcffb34ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Acquiring lock "cinder-quobyte-2cb38fad-765e-4848-bfa0-168fcffb34ee" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Lock "cinder-quobyte-2cb38fad-765e-4848-bfa0-168fcffb34ee" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:11 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5e17d4-e2a6-4b4c-bcfd-06f99fd06406]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:11 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee Jul 03 16:36:11 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:11 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee" returned: 0 in 0.827s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:12 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee Jul 03 16:36:12 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:12 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2cb38fad-765e-4848-bfa0-168fcffb34ee" returned: 0 in 0.708s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Lock "cinder-quobyte-2cb38fad-765e-4848-bfa0-168fcffb34ee" released by "delete_volume" :: held 1.575s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:12 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Created reservations ['386af7c3-8a8b-462b-9c3d-e183308310bc', '65ca0bcc-74d4-462d-8a40-755d3839f30e', 'a70c3665-6916-4e82-89c9-3295581e5dc0', '9bb64bda-1731-40e7-b363-7fdc41ba368f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:36:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:12 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:12 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:13 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.734s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:13 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Deleted volume successfully. Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-83f821ab-e4b1-4de0-8e79-503bed97301b tempest-ProjectReaderTests-714539673 None] Lock "cinder-2cb38fad-765e-4848-bfa0-168fcffb34ee-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Flow 'volume_create_manager' (e058079b-9e5e-4e93-a803-cb2ca915cf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e236de9-c3ec-4d95-9f97-9d7351b004d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e236de9-c3ec-4d95-9f97-9d7351b004d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1820269299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd27754-d0a3-4e86-bb42-3a76fd43b014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6222187fb1d4664bda31390dc76417f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:14Z,use_quota=True,user_id='2a7b9e7f37b74ce7b25bc4acf9794543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d655de-ac3e-404c-8ab0-1c4f5a9f5f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d655de-ac3e-404c-8ab0-1c4f5a9f5f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ff481e-e8e5-4d6b-8377-438d08aab6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ff481e-e8e5-4d6b-8377-438d08aab6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd27754-d0a3-4e86-bb42-3a76fd43b014', 'volume_name': 'volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc04af8a-2382-49c1-b92e-98fa1a48d4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc04af8a-2382-49c1-b92e-98fa1a48d4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42716404-1cd9-48a1-9a29-843a04d334d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:13 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Volume dbd27754-d0a3-4e86-bb42-3a76fd43b014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014', 'volume_size': 1} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1820269299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd27754-d0a3-4e86-bb42-3a76fd43b014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6222187fb1d4664bda31390dc76417f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:14Z,use_quota=True,user_id='2a7b9e7f37b74ce7b25bc4acf9794543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Creating volume dbd27754-d0a3-4e86-bb42-3a76fd43b014 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:13 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:13 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 1073741824 Jul 03 16:36:13 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:14 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 1073741824" returned: 0 in 0.982s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:15 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 Jul 03 16:36:15 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:15 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014" returned: 0 in 0.655s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42716404-1cd9-48a1-9a29-843a04d334d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96c5149-0d0c-4d20-8701-25beb81d0c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:15 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Volume volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 (dbd27754-d0a3-4e86-bb42-3a76fd43b014): created successfully Jul 03 16:36:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96c5149-0d0c-4d20-8701-25beb81d0c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Flow 'volume_create_manager' (e058079b-9e5e-4e93-a803-cb2ca915cf5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a231cb07-bc63-4eb2-89cb-da9e98973838 tempest-ProjectReaderTests-714539673 None] Created volume successfully. Jul 03 16:36:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Acquiring lock "cinder-dbd27754-d0a3-4e86-bb42-3a76fd43b014-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Lock "cinder-dbd27754-d0a3-4e86-bb42-3a76fd43b014-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Acquiring lock "cinder-quobyte-dbd27754-d0a3-4e86-bb42-3a76fd43b014" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Lock "cinder-quobyte-dbd27754-d0a3-4e86-bb42-3a76fd43b014" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:16 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[559ede6b-69c9-4be8-a214-dde2f0e65268]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:16 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 Jul 03 16:36:16 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:16 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014" returned: 0 in 0.797s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:16 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014 Jul 03 16:36:16 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:17 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dbd27754-d0a3-4e86-bb42-3a76fd43b014" returned: 0 in 0.704s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:17 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Lock "cinder-quobyte-dbd27754-d0a3-4e86-bb42-3a76fd43b014" released by "delete_volume" :: held 1.545s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:17 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Created reservations ['869a41a2-5069-49b8-955f-5e7c7cd46527', '470f5ac3-14b4-487b-b71c-62f1e01e18c0', '9866eb1f-6db0-4cc4-b727-7f62ddef835f', '08c135e8-123d-40e5-b976-d8365095388c'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:36:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:17 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:17 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:18 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.772s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Deleted volume successfully. Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ac948944-6d20-40ed-b3e9-e2c069eb8354 tempest-ProjectReaderTests-714539673 None] Lock "cinder-dbd27754-d0a3-4e86-bb42-3a76fd43b014-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:19 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:19 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:19 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.816s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:36:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:36:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:36:27 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=65,cinder:DELETE=7,cinder:SELECT=41,cinder:INSERT=20 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:36:28 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=53,cinder:INSERT=13,cinder:UPDATE=71,cinder:DELETE=5 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:36:31 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Flow 'volume_create_manager' (97ff8288-b1c8-4dd8-b040-ef2632ec157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43806066-972a-4250-b3a9-2dfff5870dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43806066-972a-4250-b3a9-2dfff5870dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-30543350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514e74e6-45ba-48ad-a1a1-3f1813ce5c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e308e414b92447e6ae0fbfe88b77f901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:32Z,use_quota=True,user_id='b7228faa0f80486b91efb67afe9fa232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb9bdc3-f83f-4dfd-ad16-cb32c531257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb9bdc3-f83f-4dfd-ad16-cb32c531257e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1f7ede-6f1f-41bf-ad98-fe8425d757ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1f7ede-6f1f-41bf-ad98-fe8425d757ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514e74e6-45ba-48ad-a1a1-3f1813ce5c70', 'volume_name': 'volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed07fcf-9335-4d58-a825-cdc75e068558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed07fcf-9335-4d58-a825-cdc75e068558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ab0d9a-81ad-4227-ab85-24aa58a917c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Volume 514e74e6-45ba-48ad-a1a1-3f1813ce5c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70', 'volume_size': 1} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-30543350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514e74e6-45ba-48ad-a1a1-3f1813ce5c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e308e414b92447e6ae0fbfe88b77f901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:32Z,use_quota=True,user_id='b7228faa0f80486b91efb67afe9fa232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Creating volume 514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:32 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:32 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 1073741824 Jul 03 16:36:32 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (319e59e3-bb5c-42b7-a030-1874db178232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae54264-ec3e-472d-95cf-8f1a44f440f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae54264-ec3e-472d-95cf-8f1a44f440f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2131224067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afde9095-a257-4d4b-ad7d-fc090ae6c59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:32Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2191bb-a91f-4f1a-b43a-444d65347637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2191bb-a91f-4f1a-b43a-444d65347637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3974680c-6dcd-4126-b1d0-977a1dabcd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3974680c-6dcd-4126-b1d0-977a1dabcd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afde9095-a257-4d4b-ad7d-fc090ae6c59a', 'volume_name': 'volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2bcc1c-754b-4cc4-855d-bde862f53ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2bcc1c-754b-4cc4-855d-bde862f53ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b41e23-d7ce-44d1-88fd-500a75bf98d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Volume afde9095-a257-4d4b-ad7d-fc090ae6c59a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a', 'volume_size': 1} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (99df87e5-f55d-482f-89b3-4e44c6577a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d68a5c3-6c4c-404a-9d19-e54a038f3319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d68a5c3-6c4c-404a-9d19-e54a038f3319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-200142879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f73d0f5-e12a-4638-8458-f38e86a22f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:32Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0217103-e07d-432a-a95e-4fc52b5562be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0217103-e07d-432a-a95e-4fc52b5562be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992d7f87-9621-473f-976d-5dcdc1a7b438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992d7f87-9621-473f-976d-5dcdc1a7b438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f73d0f5-e12a-4638-8458-f38e86a22f26', 'volume_name': 'volume-8f73d0f5-e12a-4638-8458-f38e86a22f26', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d114db5-729d-4030-b065-8d12e1ed268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d114db5-729d-4030-b065-8d12e1ed268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c313973f-f7d3-4a29-b0f7-1d878b5bbaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Volume 8f73d0f5-e12a-4638-8458-f38e86a22f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f73d0f5-e12a-4638-8458-f38e86a22f26', 'volume_size': 1} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (59c3928d-744d-493f-862c-cc6f7218cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d5dfb8-cf46-46b8-a55b-51251c1149a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d5dfb8-cf46-46b8-a55b-51251c1149a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-738718539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502a7023-8891-4c53-b7d1-b39231cd4c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:33Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93ef640-e466-47ed-973f-274124cd78e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93ef640-e466-47ed-973f-274124cd78e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3789b05b-7834-48a4-b970-83c512bd8839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3789b05b-7834-48a4-b970-83c512bd8839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502a7023-8891-4c53-b7d1-b39231cd4c2f', 'volume_name': 'volume-502a7023-8891-4c53-b7d1-b39231cd4c2f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a1cb0a-eeaa-4086-9a5b-e9a14651770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a1cb0a-eeaa-4086-9a5b-e9a14651770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc2469d-44ea-4895-b61a-ed1558f1bba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:32 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Volume 502a7023-8891-4c53-b7d1-b39231cd4c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502a7023-8891-4c53-b7d1-b39231cd4c2f', 'volume_size': 1} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6aa03ad0-25b6-4645-90cf-18ae7288efdc tempest-ProjectAdminTests-1232110490 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86659) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 16:36:33 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 1073741824" returned: 0 in 1.284s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (1815d05e-d1ea-4490-a453-c9d54a1aa82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c101493-1026-42b7-b502-1c8229a4aa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c101493-1026-42b7-b502-1c8229a4aa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-799904168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a15e113-1b2d-42a0-82f5-662b9a26c9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:33Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e3d3ee-8e7d-4a3a-873b-0314d383c6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e3d3ee-8e7d-4a3a-873b-0314d383c6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d56efa-b86d-4bea-b1a8-552f40c7651f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d56efa-b86d-4bea-b1a8-552f40c7651f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a15e113-1b2d-42a0-82f5-662b9a26c9c0', 'volume_name': 'volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb986c0-83d5-446d-8502-e8835e27984d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb986c0-83d5-446d-8502-e8835e27984d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb2168b-2aa2-4b91-b630-c987ee0ee17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:33 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Volume 7a15e113-1b2d-42a0-82f5-662b9a26c9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0', 'volume_size': 1} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:33 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 Jul 03 16:36:33 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (b9713d58-5b27-4b75-a8bd-73f7a00fa4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c78b972-8868-4847-a1a9-1ddd45ccb571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c78b972-8868-4847-a1a9-1ddd45ccb571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1570499513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7629a7b3-7e69-49ac-9413-9d255a287c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:34Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea1f44c-4af5-46b1-9fd0-03eaec46df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea1f44c-4af5-46b1-9fd0-03eaec46df73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531b66fc-9581-494e-8f83-b7408ae876a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531b66fc-9581-494e-8f83-b7408ae876a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7629a7b3-7e69-49ac-9413-9d255a287c49', 'volume_name': 'volume-7629a7b3-7e69-49ac-9413-9d255a287c49', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f922a11-b233-4246-a40b-44a095bec534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f922a11-b233-4246-a40b-44a095bec534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af8d03c-84ac-41e3-b4f3-5669504b453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:34 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Volume 7629a7b3-7e69-49ac-9413-9d255a287c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7629a7b3-7e69-49ac-9413-9d255a287c49', 'volume_size': 1} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:34 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" returned: 0 in 1.000s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.260s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2131224067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afde9095-a257-4d4b-ad7d-fc090ae6c59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:32Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Creating volume afde9095-a257-4d4b-ad7d-fc090ae6c59a {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:34 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ab0d9a-81ad-4227-ab85-24aa58a917c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388fbc40-9bad-4758-b0ba-014b806bed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:34 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a 1073741824 Jul 03 16:36:34 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:34 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Volume volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 (514e74e6-45ba-48ad-a1a1-3f1813ce5c70): created successfully Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388fbc40-9bad-4758-b0ba-014b806bed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Flow 'volume_create_manager' (97ff8288-b1c8-4dd8-b040-ef2632ec157d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6b5f1fb5-5dcd-4397-b531-df0e858f8cb0 tempest-VolumeDependencyTests-372987618 None] Created volume successfully. Jul 03 16:36:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:35 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a 1073741824" returned: 0 in 1.406s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:36 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a Jul 03 16:36:36 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:36 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a" returned: 0 in 0.786s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.156s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-200142879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f73d0f5-e12a-4638-8458-f38e86a22f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:32Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Creating volume 8f73d0f5-e12a-4638-8458-f38e86a22f26 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:36 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b41e23-d7ce-44d1-88fd-500a75bf98d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1160f8cd-6ce9-4982-8d10-76abcb2795b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:36 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 1073741824 Jul 03 16:36:36 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:36 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Volume volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a (afde9095-a257-4d4b-ad7d-fc090ae6c59a): created successfully Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1160f8cd-6ce9-4982-8d10-76abcb2795b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (319e59e3-bb5c-42b7-a030-1874db178232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:36 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-bba1c392-7c7b-406d-b31d-79eef42a772e tempest-CreateVolumesFromImageTest-975408933 None] Created volume successfully. Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Flow 'volume_create_manager' (dea54584-aee6-4c7a-ad91-e4f4f9eda85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be221a95-367e-4ac4-8553-3d46c2d1a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be221a95-367e-4ac4-8553-3d46c2d1a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e977cfa-789d-481f-bcc0-b274f6253584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52e24235dc04820b92410faa32e50be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:37Z,use_quota=True,user_id='b8ffcd46521b4d72b4249511c99b6383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f1fce53-8dc8-4932-a129-b1ab640fec23),volume_type_id=7f1fce53-8dc8-4932-a129-b1ab640fec23)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1f7971-e080-4ee0-9937-dd51908521da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1f7971-e080-4ee0-9937-dd51908521da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd142c9-cb13-408c-a948-50c49851968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.image.glance [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Creating Keystone auth plugin from conf {{(pid=86659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd142c9-cb13-408c-a948-50c49851968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e977cfa-789d-481f-bcc0-b274f6253584', 'volume_name': 'volume-7e977cfa-789d-481f-bcc0-b274f6253584', 'volume_size': 1, 'image_id': '2d1f038d-c256-449c-87c6-4b49c59f2904', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d1f038d-c256-449c-87c6-4b49c59f2904', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '386cb24bb246fdc3b70cead49069558e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a52e24235dc04820b92410faa32e50be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd23189487b35211f1705dafaf7850e87b8b2f26336331388c34b99444d2e0a071ef5c12fe44ab77f45cc97692b1de0b58a897bc09b8928538ef8bf544ea09720', 'id': '2d1f038d-c256-449c-87c6-4b49c59f2904', 'created_at': datetime.datetime(2026, 7, 3, 14, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 36, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d1f038d-c256-449c-87c6-4b49c59f2904/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e6ebc4-7b64-4498-94ac-e0504e01e03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e6ebc4-7b64-4498-94ac-e0504e01e03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:37 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361f6d9c-f880-433e-b444-c71b81ab89e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Volume 7e977cfa-789d-481f-bcc0-b274f6253584: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e977cfa-789d-481f-bcc0-b274f6253584', 'volume_size': 1, 'image_id': '2d1f038d-c256-449c-87c6-4b49c59f2904', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d1f038d-c256-449c-87c6-4b49c59f2904', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '386cb24bb246fdc3b70cead49069558e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a52e24235dc04820b92410faa32e50be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd23189487b35211f1705dafaf7850e87b8b2f26336331388c34b99444d2e0a071ef5c12fe44ab77f45cc97692b1de0b58a897bc09b8928538ef8bf544ea09720', 'id': '2d1f038d-c256-449c-87c6-4b49c59f2904', 'created_at': datetime.datetime(2026, 7, 3, 14, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 36, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d1f038d-c256-449c-87c6-4b49c59f2904/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Trying to clone 7e977cfa-789d-481f-bcc0-b274f6253584 from image 2d1f038d-c256-449c-87c6-4b49c59f2904 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d1f038d-c256-449c-87c6-4b49c59f2904', 'metadata': {}}]). {{(pid=86659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 16:36:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 1073741824" returned: 0 in 1.191s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:38 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 Jul 03 16:36:38 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 16:36:38 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Image download 0.00 MB at 0.00 MB/s Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[24866a73-ff1c-4760-abbd-2ad7f77dbd73]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:38 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD Jul 03 16:36:38 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (2cb5f96c-5606-4064-91df-e2c277e6d79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b026d6-f08a-4056-b228-1eb7b7592c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b026d6-f08a-4056-b228-1eb7b7592c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35648842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fe8ad6-ea40-4d6f-b7cd-63b70428288a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:39Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f305912-642d-4a19-8090-d08330d4a5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f305912-642d-4a19-8090-d08330d4a5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4752fec1-ef25-45d0-bd7f-75ccae9154c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4752fec1-ef25-45d0-bd7f-75ccae9154c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fe8ad6-ea40-4d6f-b7cd-63b70428288a', 'volume_name': 'volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd8fba3-6d8d-45b5-8e11-d3e9707fff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd8fba3-6d8d-45b5-8e11-d3e9707fff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b20d1d9-4b58-4d16-90d1-b5264bab5e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Volume a5fe8ad6-ea40-4d6f-b7cd-63b70428288a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a', 'volume_size': 1} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:38 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26" returned: 0 in 0.782s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.987s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-738718539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502a7023-8891-4c53-b7d1-b39231cd4c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:33Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Creating volume 502a7023-8891-4c53-b7d1-b39231cd4c2f {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:38 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:38 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f 1073741824 Jul 03 16:36:38 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c313973f-f7d3-4a29-b0f7-1d878b5bbaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f73d0f5-e12a-4638-8458-f38e86a22f26', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c6f389-3325-428f-adcc-eed97b824484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Volume volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 (8f73d0f5-e12a-4638-8458-f38e86a22f26): created successfully Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c6f389-3325-428f-adcc-eed97b824484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (99df87e5-f55d-482f-89b3-4e44c6577a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-aaef9949-4427-4550-b32d-6a577892009d tempest-CreateVolumesFromImageTest-975408933 None] Created volume successfully. Jul 03 16:36:39 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:39 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD Jul 03 16:36:39 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:39 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f 1073741824" returned: 0 in 0.892s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:39 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f Jul 03 16:36:39 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:39 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD" returned: 1 in 0.784s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:36:39 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Temporary image 2d1f038d-c256-449c-87c6-4b49c59f2904 is fetched for user b8ffcd46521b4d72b4249511c99b6383. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 16:36:39 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6becf85-63e5-4391-a696-dd41fda3595b]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:40 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD Jul 03 16:36:40 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:40 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f" returned: 0 in 0.696s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.961s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-799904168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a15e113-1b2d-42a0-82f5-662b9a26c9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:33Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Creating volume 7a15e113-1b2d-42a0-82f5-662b9a26c9c0 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:40 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:40 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 1073741824 Jul 03 16:36:40 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc2469d-44ea-4895-b61a-ed1558f1bba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502a7023-8891-4c53-b7d1-b39231cd4c2f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d8e14b-3b15-4cd2-a00f-00f7aa2dddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:40 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Volume volume-502a7023-8891-4c53-b7d1-b39231cd4c2f (502a7023-8891-4c53-b7d1-b39231cd4c2f): created successfully Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92d8e14b-3b15-4cd2-a00f-00f7aa2dddf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (59c3928d-744d-493f-862c-cc6f7218cc32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:40 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-036750ec-e8fd-4928-8075-0fe38924219b tempest-CreateVolumesFromImageTest-975408933 None] Created volume successfully. Jul 03 16:36:40 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:40 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD Jul 03 16:36:40 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:41 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 1073741824" returned: 0 in 0.899s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:41 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 Jul 03 16:36:41 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:41 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD" returned: 1 in 0.789s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:36:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:42 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0" returned: 0 in 0.687s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.049s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1570499513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7629a7b3-7e69-49ac-9413-9d255a287c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822d98d65424269b0af72c549dc564c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:34Z,use_quota=True,user_id='ad84351500b0499ea9310d4d046e94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Creating volume 7629a7b3-7e69-49ac-9413-9d255a287c49 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:42 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:42 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49 1073741824 Jul 03 16:36:42 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb2168b-2aa2-4b91-b630-c987ee0ee17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0d0216-16da-4501-815a-c74adbca4af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:42 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Volume volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 (7a15e113-1b2d-42a0-82f5-662b9a26c9c0): created successfully Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0d0216-16da-4501-815a-c74adbca4af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (1815d05e-d1ea-4490-a453-c9d54a1aa82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:42 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-59a6a199-d7ee-4a0f-8c82-5530cf582ab4 tempest-CreateVolumesFromImageTest-975408933 None] Created volume successfully. Jul 03 16:36:42 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49 1073741824" returned: 0 in 0.884s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:43 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49 Jul 03 16:36:43 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:43 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49" returned: 0 in 0.728s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.369s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af8d03c-84ac-41e3-b4f3-5669504b453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7629a7b3-7e69-49ac-9413-9d255a287c49', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00f5d47-ea9c-459a-b130-1e2464bcef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Creating offline snapshot ebd90068-9abb-4b46-9d62-89896b068a75 of volume 514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:36:43 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Volume volume-7629a7b3-7e69-49ac-9413-9d255a287c49 (7629a7b3-7e69-49ac-9413-9d255a287c49): created successfully Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00f5d47-ea9c-459a-b130-1e2464bcef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Flow 'volume_create_manager' (b9713d58-5b27-4b75-a8bd-73f7a00fa4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87aa79e-f311-4204-9c63-f65deafe1875]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:43 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fea91828-ef9e-4920-b3ba-2d9e88d4f4e0 tempest-CreateVolumesFromImageTest-975408933 None] Created volume successfully. Jul 03 16:36:43 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 Jul 03 16:36:43 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:44 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" returned: 0 in 0.829s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:44 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 1G Jul 03 16:36:44 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-7629a7b3-7e69-49ac-9413-9d255a287c49-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-7629a7b3-7e69-49ac-9413-9d255a287c49-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-quobyte-7629a7b3-7e69-49ac-9413-9d255a287c49" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-7629a7b3-7e69-49ac-9413-9d255a287c49" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:45 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c080a6d-9b67-4cb0-9422-59f6bf4a8c07]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:45 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49 Jul 03 16:36:45 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:45 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 1G" returned: 0 in 0.940s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:45 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 Jul 03 16:36:45 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:45 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49" returned: 0 in 0.893s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:46 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49 Jul 03 16:36:46 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:46 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75" returned: 0 in 0.789s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:46 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 is being set with open permissions: ugo+rw Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:46 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 Jul 03 16:36:46 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:46 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7629a7b3-7e69-49ac-9413-9d255a287c49" returned: 0 in 0.755s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-7629a7b3-7e69-49ac-9413-9d255a287c49" released by "delete_volume" :: held 1.708s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Created reservations ['a054bf85-a7a5-4d37-a5b7-d0e9411fc71d', '9ae0b1ea-2326-4898-bf25-a10616a2b65d', 'b4e395d7-4d60-4b91-9e77-977e11fb1337', '5d448850-7da2-4653-a7a1-70c7d0b977f5'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:46 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:46 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:47 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75" returned: 0 in 0.749s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-7a15e113-1b2d-42a0-82f5-662b9a26c9c0-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:47 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.info Jul 03 16:36:47 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-7a15e113-1b2d-42a0-82f5-662b9a26c9c0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-quobyte-7a15e113-1b2d-42a0-82f5-662b9a26c9c0" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-7a15e113-1b2d-42a0-82f5-662b9a26c9c0" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98aea2f-a305-42cc-a74b-21eb276e97a4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:47 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 Jul 03 16:36:47 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:47 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.763s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:47 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Deleted volume successfully. Jul 03 16:36:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2c75ce62-f15a-4d0e-b587-a5db70beeca5 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-7629a7b3-7e69-49ac-9413-9d255a287c49-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:48 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.info" returned: 0 in 0.800s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:48 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.info is being set with open permissions: ugo+rw Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:48 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.info Jul 03 16:36:48 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:48 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0" returned: 0 in 0.952s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:48 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0 Jul 03 16:36:48 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:48 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.info" returned: 0 in 0.804s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.088s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.166s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35648842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fe8ad6-ea40-4d6f-b7cd-63b70428288a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:39Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Creating volume a5fe8ad6-ea40-4d6f-b7cd-63b70428288a {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:48 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:48 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a 1073741824 Jul 03 16:36:48 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-88fd6f01-6200-4fc0-9138-336ff51362cd tempest-VolumeDependencyTests-372987618 None] Create snapshot completed successfully Jul 03 16:36:49 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7a15e113-1b2d-42a0-82f5-662b9a26c9c0" returned: 0 in 0.731s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-7a15e113-1b2d-42a0-82f5-662b9a26c9c0" released by "delete_volume" :: held 1.742s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Created reservations ['f6b8d042-d6d5-4bf0-94e8-2887fe6dc052', '4cdb356d-51af-4b2f-9c93-91f402877e2d', '71651182-b7aa-4fde-ab9d-db0d241be4b7', 'd1a4cc1c-1c48-41c3-adb7-1ebd64e97ca5'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:49 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:49 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-502a7023-8891-4c53-b7d1-b39231cd4c2f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-502a7023-8891-4c53-b7d1-b39231cd4c2f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-quobyte-502a7023-8891-4c53-b7d1-b39231cd4c2f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-502a7023-8891-4c53-b7d1-b39231cd4c2f" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e746dffd-ff18-4cde-9282-ac2fb7165b00]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:49 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f Jul 03 16:36:49 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:49 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a 1073741824" returned: 0 in 1.070s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:50 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a Jul 03 16:36:50 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:50 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.849s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:50 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Deleted volume successfully. Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f88388ed-630e-4bbb-8c8b-109053f910b3 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-7a15e113-1b2d-42a0-82f5-662b9a26c9c0-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:50 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f" returned: 0 in 1.185s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:50 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f Jul 03 16:36:50 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:50 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" returned: 0 in 0.911s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.066s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.397s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e977cfa-789d-481f-bcc0-b274f6253584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52e24235dc04820b92410faa32e50be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:37Z,use_quota=True,user_id='b8ffcd46521b4d72b4249511c99b6383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f1fce53-8dc8-4932-a129-b1ab640fec23),volume_type_id=7f1fce53-8dc8-4932-a129-b1ab640fec23)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Creating volume 7e977cfa-789d-481f-bcc0-b274f6253584 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:50 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:36:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:50 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 1073741824 Jul 03 16:36:50 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b20d1d9-4b58-4d16-90d1-b5264bab5e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6db7c9f-c8af-4890-9d57-db23afe0d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Volume volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a (a5fe8ad6-ea40-4d6f-b7cd-63b70428288a): created successfully Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6db7c9f-c8af-4890-9d57-db23afe0d56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (2cb5f96c-5606-4064-91df-e2c277e6d79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:36:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9f0d13eb-43eb-4b0f-b5fe-9b4b528a9f39 tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Flow 'volume_create_manager' (d7332a90-3444-477d-8078-d39dc17cd087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62d81d8-181a-42ab-ac89-b8f07fe054a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62d81d8-181a-42ab-ac89-b8f07fe054a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1628321609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761bb12c-6d21-409c-a843-c978cc787fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e308e414b92447e6ae0fbfe88b77f901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebd90068-9abb-4b46-9d62-89896b068a75,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:36:51Z,use_quota=True,user_id='b7228faa0f80486b91efb67afe9fa232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0a1148-fc0a-496d-a256-3a39c8d81408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0a1148-fc0a-496d-a256-3a39c8d81408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303ec49d-7ec9-4adb-a919-a9db27c18508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303ec49d-7ec9-4adb-a919-a9db27c18508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '761bb12c-6d21-409c-a843-c978cc787fd0', 'volume_name': 'volume-761bb12c-6d21-409c-a843-c978cc787fd0', 'volume_size': 1, 'snapshot_id': 'ebd90068-9abb-4b46-9d62-89896b068a75'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d78a28d-9fd7-4548-aa4c-0fc2305ce119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d78a28d-9fd7-4548-aa4c-0fc2305ce119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1905e8dc-75d1-4995-83fc-8fe88fa61362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:36:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Volume 761bb12c-6d21-409c-a843-c978cc787fd0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-761bb12c-6d21-409c-a843-c978cc787fd0', 'volume_size': 1, 'snapshot_id': 'ebd90068-9abb-4b46-9d62-89896b068a75'} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:51 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-502a7023-8891-4c53-b7d1-b39231cd4c2f" returned: 0 in 0.829s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-502a7023-8891-4c53-b7d1-b39231cd4c2f" released by "delete_volume" :: held 2.062s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Created reservations ['92c730e3-66a1-4a16-b443-b794d09c315c', '440f0844-e47c-4483-acf4-7a93425abec5', '35de7392-5386-43ed-8b41-ddfd2c764b20', 'f021800d-3391-4dc7-90bc-7fc1d5c9a37a'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:51 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:51 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-8f73d0f5-e12a-4638-8458-f38e86a22f26-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-8f73d0f5-e12a-4638-8458-f38e86a22f26-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-quobyte-8f73d0f5-e12a-4638-8458-f38e86a22f26" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-8f73d0f5-e12a-4638-8458-f38e86a22f26" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffce04f-5fb0-41ab-b8b6-2917e780000e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:52 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 1073741824" returned: 0 in 1.178s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:52 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 Jul 03 16:36:52 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:52 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 Jul 03 16:36:52 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:52 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.750s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:52 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Deleted volume successfully. Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-27916f2a-d596-4bfc-b876-0d50d58db52f tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-502a7023-8891-4c53-b7d1-b39231cd4c2f-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:52 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584" returned: 0 in 0.747s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.589s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "cinder-quobyte-ebd90068-9abb-4b46-9d62-89896b068a75-761bb12c-6d21-409c-a843-c978cc787fd0" by "_create_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-ebd90068-9abb-4b46-9d62-89896b068a75-761bb12c-6d21-409c-a843-c978cc787fd0" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Creating volume 761bb12c-6d21-409c-a843-c978cc787fd0 from snapshot ebd90068-9abb-4b46-9d62-89896b068a75 {{(pid=86659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "cinder-quobyte-761bb12c-6d21-409c-a843-c978cc787fd0" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Attempting download of 2d1f038d-c256-449c-87c6-4b49c59f2904 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d1f038d-c256-449c-87c6-4b49c59f2904', 'metadata': {}}])) to volume 7e977cfa-789d-481f-bcc0-b274f6253584. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-761bb12c-6d21-409c-a843-c978cc787fd0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] snapshot: ebd90068-9abb-4b46-9d62-89896b068a75, volume: 761bb12c-6d21-409c-a843-c978cc787fd0, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:36:53 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26" returned: 0 in 0.944s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cfae9b-9542-4aed-a3c3-e7691488d6f8]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:53 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26 Jul 03 16:36:53 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc17f05-0bec-4a7d-861c-d714f7046e84]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d1f038d-c256-449c-87c6-4b49c59f2904_rprehews {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:53 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 Jul 03 16:36:53 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:53 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d1f038d-c256-449c-87c6-4b49c59f2904_rprehews Jul 03 16:36:53 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:53 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8f73d0f5-e12a-4638-8458-f38e86a22f26" returned: 0 in 0.779s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-8f73d0f5-e12a-4638-8458-f38e86a22f26" released by "delete_volume" :: held 1.768s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Created reservations ['2f17a953-627d-41d0-b5ab-2ae51d79e7d7', 'bf752025-25a5-477e-bb10-3d532c805035', 'a83b6e8e-c09f-4e60-82a1-063b67fc89fa', '32fbf31a-dcb1-41df-aab8-dac4ea4680e2'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:36:53 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d1f038d-c256-449c-87c6-4b49c59f2904_rprehews" returned: 0 in 0.842s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d1f038d-c256-449c-87c6-4b49c59f2904_rprehews {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:53 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75" returned: 0 in 0.907s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da79f1a-3fba-4b8d-9ddb-4e22bb7273b9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:54 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d1f038d-c256-449c-87c6-4b49c59f2904_rprehews Jul 03 16:36:54 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:54 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:54 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:54 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 Jul 03 16:36:54 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-afde9095-a257-4d4b-ad7d-fc090ae6c59a-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-afde9095-a257-4d4b-ad7d-fc090ae6c59a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "cinder-quobyte-afde9095-a257-4d4b-ad7d-fc090ae6c59a" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-afde9095-a257-4d4b-ad7d-fc090ae6c59a" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbd5f3d-58cf-4824-aefb-ab8e8bb628e3]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:54 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a Jul 03 16:36:54 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:54 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.792s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:54 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Deleted volume successfully. Jul 03 16:36:54 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d1f038d-c256-449c-87c6-4b49c59f2904_rprehews" returned: 1 in 0.924s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d1f038d-c256-449c-87c6-4b49c59f2904_rprehews' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfed0a0-f311-444f-8572-bacfc6caaf36]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-50b5ca52-877a-447d-a0e1-d6ab9fa6a452 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-8f73d0f5-e12a-4638-8458-f38e86a22f26-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:54 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" returned: 0 in 0.924s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:36:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:54 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 Jul 03 16:36:54 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:54 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD Jul 03 16:36:54 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:55 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a" returned: 0 in 0.911s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:55 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a Jul 03 16:36:55 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:55 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:55 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD Jul 03 16:36:55 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:56 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-afde9095-a257-4d4b-ad7d-fc090ae6c59a" returned: 0 in 0.964s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-quobyte-afde9095-a257-4d4b-ad7d-fc090ae6c59a" released by "delete_volume" :: held 1.956s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:36:56 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Created reservations ['b939c348-8093-4947-986a-55eee6ae6a13', '0cc2fbdd-898c-4ecd-bed8-04cb2a0f73d9', 'c0f4816b-32bc-4522-846a-49f3bcf0aba6', '7208e2e9-d148-461e-8737-343edfb42633'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:36:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:36:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:36:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:36:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:36:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:36:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:56 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:36:56 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:57 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD" returned: 1 in 2.186s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:36:57 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] 2d1f038d-c256-449c-87c6-4b49c59f2904 was raw, converting to raw {{(pid=86659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 16:36:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:36:58 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 Jul 03 16:36:58 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:36:58 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 03 16:36:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.785s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:36:58 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:36:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Deleted volume successfully. Jul 03 16:36:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-e8defbb9-004b-4e9a-bec1-b5d3f5f61715 tempest-CreateVolumesFromImageTest-975408933 None] Lock "cinder-afde9095-a257-4d4b-ad7d-fc090ae6c59a-delete_volume" released by "delete_volume" :: held 4.324s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:00 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584" returned: 0 in 2.312s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:00 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d1f038d-c256-449c-87c6-4b49c59f2904__j_90v0cdevstack@QuobyteHD, size 0.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:37:00 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 16:37:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:00 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 1G Jul 03 16:37:00 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:01 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0" returned: 0 in 6.270s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bf12a6-3e18-4acc-a606-b145feee47b9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:01 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 Jul 03 16:37:01 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:01 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 1G" returned: 0 in 1.266s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:01 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba91dcb-b5b2-41de-8410-65a6a8a63e2d]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:01 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 Jul 03 16:37:01 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:02 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" returned: 0 in 1.119s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:02 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:37:02 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Converted 1024.00 MB image at 163.28 MB/s Jul 03 16:37:02 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 is being set with open permissions: ugo+rw Jul 03 16:37:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:02 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 Jul 03 16:37:02 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:02 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584" returned: 0 in 0.844s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:02 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 Jul 03 16:37:02 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:03 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0" returned: 0 in 0.723s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-761bb12c-6d21-409c-a843-c978cc787fd0" released by "_copy_volume_from_snapshot" :: held 10.086s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-ebd90068-9abb-4b46-9d62-89896b068a75-761bb12c-6d21-409c-a843-c978cc787fd0" released by "_create_volume_from_snapshot" :: held 10.129s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.156s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.141s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot b52bc41e-d7dc-4924-a0e3-f94c764d86c0 of volume a5fe8ad6-ea40-4d6f-b7cd-63b70428288a {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1905e8dc-75d1-4995-83fc-8fe88fa61362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761bb12c-6d21-409c-a843-c978cc787fd0', 'volume_size': 1, 'snapshot_id': 'ebd90068-9abb-4b46-9d62-89896b068a75'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b723a756-5ac8-4553-90a8-a03a40b663ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1cf98e-5fbb-444a-8e23-d3fb7f9e6b4f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:03 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Volume volume-761bb12c-6d21-409c-a843-c978cc787fd0 (761bb12c-6d21-409c-a843-c978cc787fd0): created successfully Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b723a756-5ac8-4553-90a8-a03a40b663ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Flow 'volume_create_manager' (d7332a90-3444-477d-8078-d39dc17cd087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:03 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584" returned: 1 in 0.843s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Downloaded image 2d1f038d-c256-449c-87c6-4b49c59f2904 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d1f038d-c256-449c-87c6-4b49c59f2904', 'metadata': {}}])) to volume 7e977cfa-789d-481f-bcc0-b274f6253584 successfully. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Temporary image 2d1f038d-c256-449c-87c6-4b49c59f2904 for user b8ffcd46521b4d72b4249511c99b6383 is deleted. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Marking volume 7e977cfa-789d-481f-bcc0-b274f6253584 as bootable. {{(pid=86659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 16:37:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-5c1ea4f8-d05b-4956-a25b-afae6d782b12 tempest-VolumeDependencyTests-372987618 None] Created volume successfully. Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Copying metadata from image 2d1f038d-c256-449c-87c6-4b49c59f2904 to 7e977cfa-789d-481f-bcc0-b274f6253584. {{(pid=86659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Creating volume glance metadata for volume 7e977cfa-789d-481f-bcc0-b274f6253584 backed by image 2d1f038d-c256-449c-87c6-4b49c59f2904 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2d1f038d-c256-449c-87c6-4b49c59f2904', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '386cb24bb246fdc3b70cead49069558e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 16:37:03 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a Jul 03 16:37:03 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361f6d9c-f880-433e-b444-c71b81ab89e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e977cfa-789d-481f-bcc0-b274f6253584', 'volume_size': 1, 'image_id': '2d1f038d-c256-449c-87c6-4b49c59f2904', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d1f038d-c256-449c-87c6-4b49c59f2904', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '386cb24bb246fdc3b70cead49069558e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a52e24235dc04820b92410faa32e50be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd23189487b35211f1705dafaf7850e87b8b2f26336331388c34b99444d2e0a071ef5c12fe44ab77f45cc97692b1de0b58a897bc09b8928538ef8bf544ea09720', 'id': '2d1f038d-c256-449c-87c6-4b49c59f2904', 'created_at': datetime.datetime(2026, 7, 3, 14, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 36, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d1f038d-c256-449c-87c6-4b49c59f2904/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413a57ed-585c-45d5-9e2c-292136f91df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "cinder-ebd90068-9abb-4b46-9d62-89896b068a75-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:03 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Volume volume-7e977cfa-789d-481f-bcc0-b274f6253584 (7e977cfa-789d-481f-bcc0-b274f6253584): created successfully Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413a57ed-585c-45d5-9e2c-292136f91df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Flow 'volume_create_manager' (dea54584-aee6-4c7a-ad91-e4f4f9eda85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-ebd90068-9abb-4b46-9d62-89896b068a75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "cinder-quobyte-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "cinder-quobyte-ebd90068-9abb-4b46-9d62-89896b068a75" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7bb2b37a-8944-46ef-8239-17a64d2a987d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Created volume successfully. Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-ebd90068-9abb-4b46-9d62-89896b068a75" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Deleting offline snapshot ebd90068-9abb-4b46-9d62-89896b068a75 of volume 514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] snapshot_file for this snap is: volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[984bff96-b35a-434c-9f26-7e03c978ab2e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:03 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 Jul 03 16:37:03 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Acquiring lock "cinder-7e977cfa-789d-481f-bcc0-b274f6253584-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "cinder-7e977cfa-789d-481f-bcc0-b274f6253584-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Acquiring lock "cinder-quobyte-7e977cfa-789d-481f-bcc0-b274f6253584" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "cinder-quobyte-7e977cfa-789d-481f-bcc0-b274f6253584" acquired by "delete_volume" :: waited 0.028s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc583671-f10e-49e0-b165-a355ffefa578]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:04 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 Jul 03 16:37:04 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:04 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" returned: 0 in 0.984s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:04 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 1G Jul 03 16:37:04 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:04 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75" returned: 0 in 1.077s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:37:04 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca2e34-9fdf-4b70-9fbe-c521dd3c422f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:04 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 Jul 03 16:37:04 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:04 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584" returned: 0 in 0.998s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:05 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 Jul 03 16:37:05 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:05 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 1G" returned: 0 in 1.154s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:05 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 Jul 03 16:37:05 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:05 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" returned: 0 in 0.984s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:05 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 Jul 03 16:37:05 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:05 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584" returned: 1 in 0.984s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:37:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:05 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584 Jul 03 16:37:05 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:06 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0" returned: 0 in 1.120s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:06 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 is being set with open permissions: ugo+rw Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:06 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 Jul 03 16:37:06 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Flow 'volume_create_manager' (b5bcfcac-7d09-4a8d-aa6c-3b3afe9af9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ff3cdb-49e7-40e2-b2ef-bb90e96c8bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:06 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ff3cdb-49e7-40e2-b2ef-bb90e96c8bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77f5348-ec47-4b91-a3ee-b01eddc21336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8990dfd30a74f2986bea774f46c149b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:06Z,use_quota=True,user_id='d691ac76142d4af683fbf4d6940076c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa292256-254c-4c7b-ad87-31e1cea56aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa292256-254c-4c7b-ad87-31e1cea56aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13813ff9-5917-44cd-8280-47f21966753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.image.glance [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Creating Keystone auth plugin from conf {{(pid=86659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75" returned: 0 in 1.009s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:06 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75 Jul 03 16:37:06 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13813ff9-5917-44cd-8280-47f21966753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c77f5348-ec47-4b91-a3ee-b01eddc21336', 'volume_name': 'volume-c77f5348-ec47-4b91-a3ee-b01eddc21336', 'volume_size': 1, 'image_id': 'f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c9ada70ca8fd61109accb12b8d20607', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8990dfd30a74f2986bea774f46c149b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '610ba10a4f15bf579c104c3d56d8eb8bab52618f33e44bc191737d67584d22f8927cae2d7da889a908647ad3d35f8afd864c0b78c6b23ae20b5b8e7dd7913950', 'id': 'f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'created_at': datetime.datetime(2026, 7, 3, 14, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 37, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f13692a0-02d0-4b7f-8808-ebdb64ffe2d8/file', 'properties': {}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:06 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f948be0c-256a-4e34-96e5-75130d3d5973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f948be0c-256a-4e34-96e5-75130d3d5973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e454eef-2d1c-4fbd-9307-9b5c44b2fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:06 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Volume c77f5348-ec47-4b91-a3ee-b01eddc21336: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c77f5348-ec47-4b91-a3ee-b01eddc21336', 'volume_size': 1, 'image_id': 'f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c9ada70ca8fd61109accb12b8d20607', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8990dfd30a74f2986bea774f46c149b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '610ba10a4f15bf579c104c3d56d8eb8bab52618f33e44bc191737d67584d22f8927cae2d7da889a908647ad3d35f8afd864c0b78c6b23ae20b5b8e7dd7913950', 'id': 'f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'created_at': datetime.datetime(2026, 7, 3, 14, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 37, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f13692a0-02d0-4b7f-8808-ebdb64ffe2d8/file', 'properties': {}}, 'image_service': } Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Trying to clone c77f5348-ec47-4b91-a3ee-b01eddc21336 from image f13692a0-02d0-4b7f-8808-ebdb64ffe2d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'metadata': {}}]). {{(pid=86659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-7e977cfa-789d-481f-bcc0-b274f6253584" returned: 0 in 1.033s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "cinder-quobyte-7e977cfa-789d-481f-bcc0-b274f6253584" released by "delete_volume" :: held 3.130s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Created reservations ['5b798944-7162-4c33-a5e6-f6fc7d61a417', '2fb698ec-beb0-407e-8bb3-fb768419718c', '92fd1f86-92b0-47e4-831b-139320d65253', 'da46b9f9-aa62-40b2-8935-0274ccf14e32'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 16:37:07 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Image download 0.00 MB at 0.00 MB/s Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9891acec-02a9-4ccf-a476-22de70ad93e6]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:07 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0" returned: 0 in 0.949s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:07 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:07 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:07 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.info Jul 03 16:37:07 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:07 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD Jul 03 16:37:07 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:07 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70.ebd90068-9abb-4b46-9d62-89896b068a75" returned: 0 in 0.969s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-ebd90068-9abb-4b46-9d62-89896b068a75" released by "_delete_snapshot" :: held 4.204s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" released by "delete_snapshot" :: held 4.248s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Created reservations ['50abf1d5-e637-4a46-bca8-d71c8ea0f288', 'b876527e-d9af-4d25-8305-b55207f94124', 'babf1d4e-78d3-49ad-8f76-f5c0d3c9b043', '4c1b3bbb-3e40-4bd5-a3d2-6605db371069'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:07 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Delete snapshot completed successfully. Jul 03 16:37:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-23c6e7da-70e0-4f9f-8090-3f305971b539 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-ebd90068-9abb-4b46-9d62-89896b068a75-delete_snapshot" released by "delete_snapshot" :: held 4.485s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:08 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.863s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:08 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Deleted volume successfully. Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-598431dd-30f4-4fcc-bfe7-b7734b9c307d tempest-VolumeAndVolumeTypeFromImageTest-2040611777 None] Lock "cinder-7e977cfa-789d-481f-bcc0-b274f6253584-delete_volume" released by "delete_volume" :: held 4.498s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:08 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.info" returned: 0 in 0.907s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:08 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.info is being set with open permissions: ugo+rw Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:08 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.info Jul 03 16:37:08 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:08 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD" returned: 0 in 1.115s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:08 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD Jul 03 16:37:08 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "cinder-514e74e6-45ba-48ad-a1a1-3f1813ce5c70-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-514e74e6-45ba-48ad-a1a1-3f1813ce5c70-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "cinder-quobyte-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:08 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" acquired by "delete_volume" :: waited 0.046s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:09 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f94725-646c-49d5-a58d-f324b8ac03a7]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:09 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 Jul 03 16:37:09 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:09 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.info" returned: 0 in 1.016s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.287s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:09 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2108c4d7-f2a5-423a-8821-7b136b0e2da0 tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:37:09 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD" returned: 1 in 1.109s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:37:09 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Temporary image f13692a0-02d0-4b7f-8808-ebdb64ffe2d8 is fetched for user d691ac76142d4af683fbf4d6940076c1. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 16:37:09 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b005d1-2fc6-4e4e-be39-670178defa22]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:09 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD Jul 03 16:37:09 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:10 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" returned: 0 in 1.082s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:10 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70 Jul 03 16:37:10 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-b52bc41e-d7dc-4924-a0e3-f94c764d86c0-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Lock "cinder-b52bc41e-d7dc-4924-a0e3-f94c764d86c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-b52bc41e-d7dc-4924-a0e3-f94c764d86c0" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-b52bc41e-d7dc-4924-a0e3-f94c764d86c0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Deleting offline snapshot b52bc41e-d7dc-4924-a0e3-f94c764d86c0 of volume a5fe8ad6-ea40-4d6f-b7cd-63b70428288a {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] snapshot_file for this snap is: volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[176a2315-cd67-4464-9acc-c2ba13265fec]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:10 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 Jul 03 16:37:10 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:10 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD" returned: 0 in 1.006s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:10 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD Jul 03 16:37:10 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:11 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" returned: 0 in 0.961s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-514e74e6-45ba-48ad-a1a1-3f1813ce5c70" released by "delete_volume" :: held 2.157s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Created reservations ['535684d7-7ba4-442f-ad43-602927ba844d', '2d233869-5f00-4395-95bf-c7ac1eaaf2a7', 'b9f1ecb5-2fea-4eb2-849c-a2b6ef3db039', '7e69e7c3-04e1-4155-ba80-5cfce152041d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:11 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:11 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:11 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0" returned: 0 in 1.150s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e2106d-c395-490c-bcb0-3159f0d9d96a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:11 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD" returned: 1 in 1.077s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77f5348-ec47-4b91-a3ee-b01eddc21336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8990dfd30a74f2986bea774f46c149b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:06Z,use_quota=True,user_id='d691ac76142d4af683fbf4d6940076c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Creating volume c77f5348-ec47-4b91-a3ee-b01eddc21336 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:11 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:11 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 1073741824 Jul 03 16:37:11 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:11 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a Jul 03 16:37:11 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "cinder-761bb12c-6d21-409c-a843-c978cc787fd0-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-761bb12c-6d21-409c-a843-c978cc787fd0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:12 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.028s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Deleted volume successfully. Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "cinder-quobyte-761bb12c-6d21-409c-a843-c978cc787fd0" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-0dc55fce-1786-4ee2-a868-863fa5dcf327 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-514e74e6-45ba-48ad-a1a1-3f1813ce5c70-delete_volume" released by "delete_volume" :: held 3.639s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-761bb12c-6d21-409c-a843-c978cc787fd0" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e0b1dd-640f-480f-af5d-bfc7d79706b8]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:12 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 Jul 03 16:37:12 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:12 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" returned: 0 in 1.315s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:12 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 Jul 03 16:37:12 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:12 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 1073741824" returned: 0 in 1.263s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:13 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 Jul 03 16:37:13 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:13 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0" returned: 0 in 0.957s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:13 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0 Jul 03 16:37:13 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:13 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0" returned: 0 in 1.037s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:13 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336" returned: 0 in 0.950s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] <== create_volume: return (2277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:13 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0 Jul 03 16:37:13 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:13 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Attempting download of f13692a0-02d0-4b7f-8808-ebdb64ffe2d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'metadata': {}}])) to volume c77f5348-ec47-4b91-a3ee-b01eddc21336. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d9db6c-9a9b-4adb-86c2-9b746bb99b1c]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_m85eg_qr {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:14 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_m85eg_qr Jul 03 16:37:14 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:14 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-761bb12c-6d21-409c-a843-c978cc787fd0" returned: 0 in 0.896s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-quobyte-761bb12c-6d21-409c-a843-c978cc787fd0" released by "delete_volume" :: held 1.914s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Created reservations ['41fe5678-2fe9-4cee-bfbe-a8a01289f697', 'c8d72590-1d35-4fe0-8b92-df9cf21edb91', '5be7c8e8-3720-4edb-8384-7c054bd35d50', 'db84f557-2cf6-47a8-b3dd-4a515294c653'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:14 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:14 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:14 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a.b52bc41e-d7dc-4924-a0e3-f94c764d86c0" returned: 0 in 0.904s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-b52bc41e-d7dc-4924-a0e3-f94c764d86c0" released by "_delete_snapshot" :: held 4.567s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" released by "delete_snapshot" :: held 4.605s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (c19179e0-c10d-40c4-b870-ab2048918731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a11abdd-a533-49db-9aa0-aa8bfe5d5b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a11abdd-a533-49db-9aa0-aa8bfe5d5b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365209667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876839b1-fd1d-4901-a421-f0f2bd2a53e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:15Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63b4faa-70c9-4c00-981f-bf9f266092b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63b4faa-70c9-4c00-981f-bf9f266092b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01644c46-044c-4b32-96ce-0215347bd584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01644c46-044c-4b32-96ce-0215347bd584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876839b1-fd1d-4901-a421-f0f2bd2a53e6', 'volume_name': 'volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de655688-b45e-40bc-b8c0-a3fb9ea7d1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de655688-b45e-40bc-b8c0-a3fb9ea7d1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64daa7bd-d872-44e3-b21e-520f545e0177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:15 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume 876839b1-fd1d-4901-a421-f0f2bd2a53e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6', 'volume_size': 1} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365209667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876839b1-fd1d-4901-a421-f0f2bd2a53e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:15Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Creating volume 876839b1-fd1d-4901-a421-f0f2bd2a53e6 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:15 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:15 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 1073741824 Jul 03 16:37:15 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:15 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Created reservations ['6d5a24d7-d7b4-4087-977a-e92c88dc5120', '4340aeb2-8707-4299-a73a-68e6160bacb9', 'a54a2cac-ede7-41ca-bed1-f0ec36cec6ec', 'a853a9c2-b2c4-4a56-bc69-903d08972bea'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_m85eg_qr" returned: 0 in 1.120s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_m85eg_qr {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Delete snapshot completed successfully. Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c7b89d91-f83f-4bf7-a1e7-bbfead86cf4e tempest-ProjectMemberTests-1209623427 None] Lock "cinder-b52bc41e-d7dc-4924-a0e3-f94c764d86c0-delete_snapshot" released by "delete_snapshot" :: held 5.075s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:15 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_m85eg_qr Jul 03 16:37:15 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:15 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.089s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Deleted volume successfully. Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-69ed4bfe-09f1-48f1-b7f9-2f633813b3b9 tempest-VolumeDependencyTests-372987618 None] Lock "cinder-761bb12c-6d21-409c-a843-c978cc787fd0-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:16 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7bc5ee-2936-44a2-b25f-b7b41e14434f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:16 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a Jul 03 16:37:16 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:16 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 1073741824" returned: 0 in 1.452s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:16 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_m85eg_qr" returned: 1 in 1.372s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_m85eg_qr' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:37:16 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e8972a-fdc0-4ab0-8480-d48abdfc9d26]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:16 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 Jul 03 16:37:16 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:16 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD Jul 03 16:37:16 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:17 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" returned: 0 in 1.288s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:17 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a Jul 03 16:37:17 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:17 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6" returned: 0 in 0.875s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.413s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64daa7bd-d872-44e3-b21e-520f545e0177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbea08b-ec38-4232-b448-2094202bd769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:17 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 (876839b1-fd1d-4901-a421-f0f2bd2a53e6): created successfully Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbea08b-ec38-4232-b448-2094202bd769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (c19179e0-c10d-40c4-b870-ab2048918731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:17 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0f51f6d1-ea71-4d8c-a31e-896ae0ccc11f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created volume successfully. Jul 03 16:37:17 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD" returned: 0 in 1.118s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:17 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD Jul 03 16:37:17 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:18 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" returned: 0 in 1.002s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a" released by "delete_volume" :: held 2.422s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Creating offline snapshot 7981c7f5-cfd4-4af3-a4e7-d1143d26b109 of volume 876839b1-fd1d-4901-a421-f0f2bd2a53e6 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef2269-a55c-440a-8b04-5afc24840aee]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Created reservations ['644f87a1-00bf-4efa-8752-0eb7f2dc2a14', 'b3db483a-16e2-43f1-984d-b1a39b08513d', 'ac19facc-ce69-416a-88b0-9b6cf2ac740b', '3bd82e3d-a201-47f1-9cd2-f1f4678543c7'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:18 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 Jul 03 16:37:18 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:18 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:18 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:18 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD" returned: 1 in 1.082s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] f13692a0-02d0-4b7f-8808-ebdb64ffe2d8 was raw, converting to raw {{(pid=86659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:18 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 Jul 03 16:37:18 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:19 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:19 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:19 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.861s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:19 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Deleted volume successfully. Jul 03 16:37:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-420fe555-899a-4b87-99f7-9b153883e6d1 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-a5fe8ad6-ea40-4d6f-b7cd-63b70428288a-delete_volume" released by "delete_volume" :: held 3.839s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:19 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6" returned: 0 in 1.249s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:19 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 1G Jul 03 16:37:19 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Flow 'volume_create_manager' (fa275af3-13c5-42f3-b74b-311ecc346c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a308d42a-c015-4edd-bab8-ff7d3de1b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336" returned: 0 in 1.450s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f13692a0-02d0-4b7f-8808-ebdb64ffe2d8_8pyh61yndevstack@QuobyteHD, size 0.00 MB, duration 1.45 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:37:20 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a308d42a-c015-4edd-bab8-ff7d3de1b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb585011-fea2-440b-9bba-17f391ace2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd58b70e3b4496da076e4ff488187c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:20Z,use_quota=True,user_id='39156470314f4a10af25b93066fc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8920020-b00e-428b-ab79-f1a0ddb58132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8920020-b00e-428b-ab79-f1a0ddb58132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:20 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 1G Jul 03 16:37:20 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829f61cc-1b70-4280-b0d7-da77329b8103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829f61cc-1b70-4280-b0d7-da77329b8103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb585011-fea2-440b-9bba-17f391ace2eb', 'volume_name': 'volume-eb585011-fea2-440b-9bba-17f391ace2eb', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebebe1c-7a97-44d9-8c66-4d78d1cfb4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebebe1c-7a97-44d9-8c66-4d78d1cfb4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9759ab-1a3d-42ed-90f4-91714fccbc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Volume eb585011-fea2-440b-9bba-17f391ace2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb585011-fea2-440b-9bba-17f391ace2eb', 'volume_size': 1} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:20 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (0a1d6f9a-87a1-4382-9fa6-702b9a273702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490c1430-e024-4413-aede-0973cbba3c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.398s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490c1430-e024-4413-aede-0973cbba3c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226625152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2255ae54-c797-42c1-accb-7aed72c7024a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:20Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd2852c-5fdf-4562-9983-96d7ac5290c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd2852c-5fdf-4562-9983-96d7ac5290c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de93ffc-5355-47a7-99d0-f01882462e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de93ffc-5355-47a7-99d0-f01882462e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2255ae54-c797-42c1-accb-7aed72c7024a', 'volume_name': 'volume-2255ae54-c797-42c1-accb-7aed72c7024a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102cc242-e633-4795-8637-81be44c79c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102cc242-e633-4795-8637-81be44c79c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db48836c-8645-44c4-a238-60793de930bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:20 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Volume 2255ae54-c797-42c1-accb-7aed72c7024a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2255ae54-c797-42c1-accb-7aed72c7024a', 'volume_size': 1} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:20 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 1G" returned: 0 in 1.222s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:21 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 Jul 03 16:37:21 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:21 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 1G" returned: 0 in 0.799s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:21 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0be9538-f18a-451e-86c4-ee0afa3c0968]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:21 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 Jul 03 16:37:21 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:21 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109" returned: 0 in 0.812s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:21 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 is being set with open permissions: ugo+rw Jul 03 16:37:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:21 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 Jul 03 16:37:21 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:21 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336" returned: 0 in 0.875s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:22 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 Jul 03 16:37:22 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:22 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109" returned: 0 in 0.745s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:22 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.info Jul 03 16:37:22 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:23 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336" returned: 1 in 1.029s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Downloaded image f13692a0-02d0-4b7f-8808-ebdb64ffe2d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'metadata': {}}])) to volume c77f5348-ec47-4b91-a3ee-b01eddc21336 successfully. {{(pid=86659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Temporary image f13692a0-02d0-4b7f-8808-ebdb64ffe2d8 for user d691ac76142d4af683fbf4d6940076c1 is deleted. {{(pid=86659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.volume.volume_utils [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Marking volume c77f5348-ec47-4b91-a3ee-b01eddc21336 as bootable. {{(pid=86659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Copying metadata from image f13692a0-02d0-4b7f-8808-ebdb64ffe2d8 to c77f5348-ec47-4b91-a3ee-b01eddc21336. {{(pid=86659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Creating volume glance metadata for volume c77f5348-ec47-4b91-a3ee-b01eddc21336 backed by image f13692a0-02d0-4b7f-8808-ebdb64ffe2d8 with: {'image_id': 'f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8c9ada70ca8fd61109accb12b8d20607', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e454eef-2d1c-4fbd-9307-9b5c44b2fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77f5348-ec47-4b91-a3ee-b01eddc21336', 'volume_size': 1, 'image_id': 'f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c9ada70ca8fd61109accb12b8d20607', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8990dfd30a74f2986bea774f46c149b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '610ba10a4f15bf579c104c3d56d8eb8bab52618f33e44bc191737d67584d22f8927cae2d7da889a908647ad3d35f8afd864c0b78c6b23ae20b5b8e7dd7913950', 'id': 'f13692a0-02d0-4b7f-8808-ebdb64ffe2d8', 'created_at': datetime.datetime(2026, 7, 3, 14, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 14, 37, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f13692a0-02d0-4b7f-8808-ebdb64ffe2d8/file', 'properties': {}}, 'image_service': }' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1edeb7f-f035-4305-92d1-d08d53ac71d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:23 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Volume volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 (c77f5348-ec47-4b91-a3ee-b01eddc21336): created successfully Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1edeb7f-f035-4305-92d1-d08d53ac71d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Flow 'volume_create_manager' (b5bcfcac-7d09-4a8d-aa6c-3b3afe9af9e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:23 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-cf789b69-e77e-4df5-83b4-807fcad15277 tempest-VolumeImageDependencyTests-984835045 None] Created volume successfully. Jul 03 16:37:23 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.info" returned: 0 in 0.788s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:23 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.info is being set with open permissions: ugo+rw Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:23 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.info Jul 03 16:37:23 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Acquiring lock "cinder-c77f5348-ec47-4b91-a3ee-b01eddc21336-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Lock "cinder-c77f5348-ec47-4b91-a3ee-b01eddc21336-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Acquiring lock "cinder-quobyte-c77f5348-ec47-4b91-a3ee-b01eddc21336" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Lock "cinder-quobyte-c77f5348-ec47-4b91-a3ee-b01eddc21336" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bc958a-0ad8-4e81-9c4b-1e28aece021c]: (4, 'raw') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:23 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 Jul 03 16:37:23 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:24 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.info" returned: 0 in 0.804s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.758s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.867s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb585011-fea2-440b-9bba-17f391ace2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd58b70e3b4496da076e4ff488187c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:20Z,use_quota=True,user_id='39156470314f4a10af25b93066fc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Creating volume eb585011-fea2-440b-9bba-17f391ace2eb {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:24 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:24 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb 1073741824 Jul 03 16:37:24 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:24 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e4dca5a4-a122-4fd8-b80b-55cbd517a77a tempest-CreateVolumesFromSnapshotTest-1325841615 None] Create snapshot completed successfully Jul 03 16:37:24 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336" returned: 0 in 1.044s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:24 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 Jul 03 16:37:24 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:25 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb 1073741824" returned: 0 in 1.029s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:25 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb Jul 03 16:37:25 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:25 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336" returned: 1 in 0.973s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336' failed. Not Retrying. {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:25 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336 Jul 03 16:37:25 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (9b13fffd-1b4a-41de-a051-60127509ef07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c946c9b-04ab-4f89-bc1f-a7a739cac737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c946c9b-04ab-4f89-bc1f-a7a739cac737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937501619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c9538c-c329-4a7e-ba11-a3282c820e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:26Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2796ebb3-e197-4aa7-acf3-ecbcfdf65f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2796ebb3-e197-4aa7-acf3-ecbcfdf65f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4c0434-8f67-4881-9052-58302e162a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4c0434-8f67-4881-9052-58302e162a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c9538c-c329-4a7e-ba11-a3282c820e68', 'volume_name': 'volume-d2c9538c-c329-4a7e-ba11-a3282c820e68', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45b462d-a8b0-4069-90fe-83e5e287dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45b462d-a8b0-4069-90fe-83e5e287dd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6150fc73-b9b3-43fd-8ce1-285de78ffc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:25 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume d2c9538c-c329-4a7e-ba11-a3282c820e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c9538c-c329-4a7e-ba11-a3282c820e68', 'volume_size': 1} Jul 03 16:37:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (a7f33ca0-1c4a-4505-818e-e8d765343052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3263663-b672-4e8a-802f-c43d1927b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:26 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb" returned: 0 in 1.050s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.882s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226625152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2255ae54-c797-42c1-accb-7aed72c7024a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:20Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Creating volume 2255ae54-c797-42c1-accb-7aed72c7024a {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:26 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3263663-b672-4e8a-802f-c43d1927b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1956393940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faddf811-1e56-468e-a903-78f4bf5bc887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:26Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ada4c1b-755f-465e-8f3c-8c35ba265b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:26 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a 1073741824 Jul 03 16:37:26 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ada4c1b-755f-465e-8f3c-8c35ba265b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c899da23-bf59-44a0-9b66-fecddf29ca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c899da23-bf59-44a0-9b66-fecddf29ca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faddf811-1e56-468e-a903-78f4bf5bc887', 'volume_name': 'volume-faddf811-1e56-468e-a903-78f4bf5bc887', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f8baab-78ac-468f-9293-475de711c10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f8baab-78ac-468f-9293-475de711c10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbfc1cc8-e31a-4557-8908-da9a7091b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume faddf811-1e56-468e-a903-78f4bf5bc887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faddf811-1e56-468e-a903-78f4bf5bc887', 'volume_size': 1} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9759ab-1a3d-42ed-90f4-91714fccbc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb585011-fea2-440b-9bba-17f391ace2eb', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14aedcfc-bcff-4c78-bf78-66c804a1aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Volume volume-eb585011-fea2-440b-9bba-17f391ace2eb (eb585011-fea2-440b-9bba-17f391ace2eb): created successfully Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14aedcfc-bcff-4c78-bf78-66c804a1aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:26 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Flow 'volume_create_manager' (fa275af3-13c5-42f3-b74b-311ecc346c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c77f5348-ec47-4b91-a3ee-b01eddc21336" returned: 0 in 0.971s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Lock "cinder-quobyte-c77f5348-ec47-4b91-a3ee-b01eddc21336" released by "delete_volume" :: held 3.068s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:26 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-408c9ad8-26a7-44d7-824e-1d245235b0b3 tempest-CinderUnicodeTest-1754415317 None] Created volume successfully. Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Created reservations ['b81a4651-dc8c-43dc-a816-3b1597e4a6e4', '160b2024-7f11-4a0e-a043-80083b370caa', '04e89710-1a40-4e02-9d84-4d8c6171e578', '86ed6874-a4d3-44e5-88a6-ed14fced5101'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:26 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:26 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (d68f5022-e6cb-4112-94c4-856c919c6ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106f6180-500f-4720-821e-f4d3e20bfddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106f6180-500f-4720-821e-f4d3e20bfddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1531350734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dceca9-3061-4bc8-8b43-794bcf2a576e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:27Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f732faa-7adf-4d7f-8873-e21472f27462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f732faa-7adf-4d7f-8873-e21472f27462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca312924-775e-4c6b-83bb-167bf83bda76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca312924-775e-4c6b-83bb-167bf83bda76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12dceca9-3061-4bc8-8b43-794bcf2a576e', 'volume_name': 'volume-12dceca9-3061-4bc8-8b43-794bcf2a576e', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905f6918-1f51-47ae-9222-33efd60e1824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905f6918-1f51-47ae-9222-33efd60e1824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d997dd9-78af-4209-8337-c759da594abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume 12dceca9-3061-4bc8-8b43-794bcf2a576e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12dceca9-3061-4bc8-8b43-794bcf2a576e', 'volume_size': 1} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (a1f3a8b0-a10f-4755-a056-438d18311e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6791497a-a581-485c-895e-737b0e0d41cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6791497a-a581-485c-895e-737b0e0d41cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-573442891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55919adb-1a7b-4671-91f6-8c82e7135715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:27Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89476d4-9ef8-4ba1-a513-e1074bdef22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89476d4-9ef8-4ba1-a513-e1074bdef22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a734f255-73db-49ad-8ba8-baab08816085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a734f255-73db-49ad-8ba8-baab08816085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55919adb-1a7b-4671-91f6-8c82e7135715', 'volume_name': 'volume-55919adb-1a7b-4671-91f6-8c82e7135715', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b430baed-e39b-4ce6-86da-169995e4ad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b430baed-e39b-4ce6-86da-169995e4ad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51849560-36a7-42f9-9f51-6af76080813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:27 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume 55919adb-1a7b-4671-91f6-8c82e7135715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55919adb-1a7b-4671-91f6-8c82e7135715', 'volume_size': 1} Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:27 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a 1073741824" returned: 0 in 1.629s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=141,cinder:SELECT=121,cinder:INSERT=42,cinder:DELETE=13 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:37:28 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.203s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Deleted volume successfully. Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-13512323-283d-426e-8954-b1cea897561e tempest-VolumeImageDependencyTests-984835045 None] Lock "cinder-c77f5348-ec47-4b91-a3ee-b01eddc21336-delete_volume" released by "delete_volume" :: held 4.665s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:28 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a Jul 03 16:37:28 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (20ccded4-94bd-4bcb-aef3-aaef3a976889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a294a9e9-73af-4017-8c27-d2a4c2b1d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a294a9e9-73af-4017-8c27-d2a4c2b1d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-207438811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7a8503-5e08-48a7-9d65-316a938a2fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:28Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a204727a-79cf-4fb2-99a4-71181aae770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a204727a-79cf-4fb2-99a4-71181aae770d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e808ad-8b5f-464b-bcfb-81eba854ebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e808ad-8b5f-464b-bcfb-81eba854ebcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7a8503-5e08-48a7-9d65-316a938a2fc1', 'volume_name': 'volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d43a398-dc63-43d5-9a44-7058f846a2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d43a398-dc63-43d5-9a44-7058f846a2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57600231-f71e-4a25-b103-8a0a35f53312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:28 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume 5d7a8503-5e08-48a7-9d65-316a938a2fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1', 'volume_size': 1} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=107,cinder:UPDATE=134,cinder:INSERT=40,cinder:DELETE=12 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Flow 'volume_create_manager' (25ce2109-ff67-4f92-bacd-ecafeebfd8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44681acd-d4d4-4d93-ab75-6d85f6da7e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44681acd-d4d4-4d93-ab75-6d85f6da7e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1612430472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0557d1ab-a566-49ee-ab68-91a0854835ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd58b70e3b4496da076e4ff488187c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:29Z,use_quota=True,user_id='39156470314f4a10af25b93066fc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167979c9-bcbc-4b72-b3e9-d387c1aa7d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167979c9-bcbc-4b72-b3e9-d387c1aa7d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215a68ec-b27d-46cc-9a9f-d125319d4f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215a68ec-b27d-46cc-9a9f-d125319d4f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0557d1ab-a566-49ee-ab68-91a0854835ed', 'volume_name': 'volume-0557d1ab-a566-49ee-ab68-91a0854835ed', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5a124a-8346-4a40-8937-253c5ebc95bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5a124a-8346-4a40-8937-253c5ebc95bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f10bf68-2834-4ca4-a8c6-aea79b9d82b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:29 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Volume 0557d1ab-a566-49ee-ab68-91a0854835ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0557d1ab-a566-49ee-ab68-91a0854835ed', 'volume_size': 1} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:29 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a" returned: 0 in 1.160s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (2925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.929s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.333s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937501619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c9538c-c329-4a7e-ba11-a3282c820e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:26Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Creating volume d2c9538c-c329-4a7e-ba11-a3282c820e68 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:29 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db48836c-8645-44c4-a238-60793de930bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2255ae54-c797-42c1-accb-7aed72c7024a', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:29 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 1073741824 Jul 03 16:37:29 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea13b6b-042f-4f2c-9493-5fd717c98bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:29 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Volume volume-2255ae54-c797-42c1-accb-7aed72c7024a (2255ae54-c797-42c1-accb-7aed72c7024a): created successfully Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea13b6b-042f-4f2c-9493-5fd717c98bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:29 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (0a1d6f9a-87a1-4382-9fa6-702b9a273702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b7a4403d-4ab9-4ec8-a367-f5aaf5985fe3 tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:37:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:30 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 1073741824" returned: 0 in 1.105s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:30 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 Jul 03 16:37:30 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:31 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68" returned: 0 in 0.822s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.818s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1956393940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faddf811-1e56-468e-a903-78f4bf5bc887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:26Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Creating volume faddf811-1e56-468e-a903-78f4bf5bc887 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:31 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6150fc73-b9b3-43fd-8ce1-285de78ffc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c9538c-c329-4a7e-ba11-a3282c820e68', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:31 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887 1073741824 Jul 03 16:37:31 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471fd880-c6b0-43f9-80e2-1bd5cea61e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:31 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 (d2c9538c-c329-4a7e-ba11-a3282c820e68): created successfully Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471fd880-c6b0-43f9-80e2-1bd5cea61e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:31 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (9b13fffd-1b4a-41de-a051-60127509ef07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:31 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-50dceb02-6454-47af-ba4c-943f360183e7 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created volume successfully. Jul 03 16:37:32 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887 1073741824" returned: 0 in 1.076s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:32 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887 Jul 03 16:37:32 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:33 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887" returned: 0 in 0.830s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.216s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1531350734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dceca9-3061-4bc8-8b43-794bcf2a576e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:27Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Creating volume 12dceca9-3061-4bc8-8b43-794bcf2a576e {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:33 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:33 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e 1073741824 Jul 03 16:37:33 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbfc1cc8-e31a-4557-8908-da9a7091b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faddf811-1e56-468e-a903-78f4bf5bc887', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13de163-ed68-440a-be7b-2d561d367392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:33 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume volume-faddf811-1e56-468e-a903-78f4bf5bc887 (faddf811-1e56-468e-a903-78f4bf5bc887): created successfully Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13de163-ed68-440a-be7b-2d561d367392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:33 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (a7f33ca0-1c4a-4505-818e-e8d765343052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b53b3f7c-477a-406e-9135-798347675fbd tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created volume successfully. Jul 03 16:37:34 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e 1073741824" returned: 0 in 1.029s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:34 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e Jul 03 16:37:34 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:35 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e" returned: 0 in 0.890s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.493s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-573442891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55919adb-1a7b-4671-91f6-8c82e7135715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:27Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Creating volume 55919adb-1a7b-4671-91f6-8c82e7135715 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:35 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d997dd9-78af-4209-8337-c759da594abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12dceca9-3061-4bc8-8b43-794bcf2a576e', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:35 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715 1073741824 Jul 03 16:37:35 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eda3f60-cd21-445e-93f3-53706a17e733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:35 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume volume-12dceca9-3061-4bc8-8b43-794bcf2a576e (12dceca9-3061-4bc8-8b43-794bcf2a576e): created successfully Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eda3f60-cd21-445e-93f3-53706a17e733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:35 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (d68f5022-e6cb-4112-94c4-856c919c6ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:35 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2abba783-bbc2-4337-97e9-4138195b01df tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created volume successfully. Jul 03 16:37:36 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715 1073741824" returned: 0 in 0.983s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:36 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715 Jul 03 16:37:36 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:37 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715" returned: 0 in 0.772s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.457s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-207438811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7a8503-5e08-48a7-9d65-316a938a2fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ff64dc0026a418ab0e9e9c3049ac3d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:28Z,use_quota=True,user_id='db6bcb6ff3c54e88882f9ba99311e761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Creating volume 5d7a8503-5e08-48a7-9d65-316a938a2fc1 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:37 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51849560-36a7-42f9-9f51-6af76080813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55919adb-1a7b-4671-91f6-8c82e7135715', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:37 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 1073741824 Jul 03 16:37:37 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad3ec63-5664-495e-8bbe-8af0ef287fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:37 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume volume-55919adb-1a7b-4671-91f6-8c82e7135715 (55919adb-1a7b-4671-91f6-8c82e7135715): created successfully Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad3ec63-5664-495e-8bbe-8af0ef287fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:37 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (a1f3a8b0-a10f-4755-a056-438d18311e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-414cdf43-c68f-4db9-b20b-39372c6f392d tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created volume successfully. Jul 03 16:37:38 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 1073741824" returned: 0 in 1.079s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:38 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 Jul 03 16:37:38 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:38 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1" returned: 0 in 0.759s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.918s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1612430472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0557d1ab-a566-49ee-ab68-91a0854835ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd58b70e3b4496da076e4ff488187c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:29Z,use_quota=True,user_id='39156470314f4a10af25b93066fc6198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Creating volume 0557d1ab-a566-49ee-ab68-91a0854835ed {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:38 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:39 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed 1073741824 Jul 03 16:37:39 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57600231-f71e-4a25-b103-8a0a35f53312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960224a5-7a6c-4572-8060-efa976b0b3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:39 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Volume volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 (5d7a8503-5e08-48a7-9d65-316a938a2fc1): created successfully Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960224a5-7a6c-4572-8060-efa976b0b3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Flow 'volume_create_manager' (20ccded4-94bd-4bcb-aef3-aaef3a976889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:39 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f0640e9e-b423-4f56-bdbb-9ebaadf9dba6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created volume successfully. Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-5d7a8503-5e08-48a7-9d65-316a938a2fc1-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-5d7a8503-5e08-48a7-9d65-316a938a2fc1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-quobyte-5d7a8503-5e08-48a7-9d65-316a938a2fc1" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-5d7a8503-5e08-48a7-9d65-316a938a2fc1" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31909b6-2a57-430f-99e7-805adf44286a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:39 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 Jul 03 16:37:39 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:40 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed 1073741824" returned: 0 in 1.229s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:40 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed Jul 03 16:37:40 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:40 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1" returned: 0 in 1.078s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:40 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1 Jul 03 16:37:40 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:41 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed" returned: 0 in 0.848s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.804s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f10bf68-2834-4ca4-a8c6-aea79b9d82b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0557d1ab-a566-49ee-ab68-91a0854835ed', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8965c9-ea72-4ada-bc25-f69b290aab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot 6f554aeb-90ee-4241-816f-d0b0de98c8a5 of volume 2255ae54-c797-42c1-accb-7aed72c7024a {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:37:41 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Volume volume-0557d1ab-a566-49ee-ab68-91a0854835ed (0557d1ab-a566-49ee-ab68-91a0854835ed): created successfully Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8965c9-ea72-4ada-bc25-f69b290aab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Flow 'volume_create_manager' (25ce2109-ff67-4f92-bacd-ecafeebfd8df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4214df-5025-4d2b-a1b3-202dd036a4a9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:41 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-721e8952-e5c3-4cba-9338-0ea5c5463dde tempest-CinderUnicodeTest-1754415317 None] Created volume successfully. Jul 03 16:37:41 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a Jul 03 16:37:41 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:41 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5d7a8503-5e08-48a7-9d65-316a938a2fc1" returned: 0 in 0.863s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-5d7a8503-5e08-48a7-9d65-316a938a2fc1" released by "delete_volume" :: held 2.004s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created reservations ['04ce62dd-96bf-4292-a800-a46d002ba1e0', '10cbb58a-bfba-4a3d-8416-1bda772781df', '50faf9d3-2711-4dea-8816-b8dce5df743e', 'a1263f66-2514-40a3-adbd-69cc5a7d607e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:41 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:41 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-55919adb-1a7b-4671-91f6-8c82e7135715-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-55919adb-1a7b-4671-91f6-8c82e7135715-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-quobyte-55919adb-1a7b-4671-91f6-8c82e7135715" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-55919adb-1a7b-4671-91f6-8c82e7135715" acquired by "delete_volume" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:42 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4e8fc0-75e5-44b9-bb20-acc37a6dc1a8]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:42 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715 Jul 03 16:37:42 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:42 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a" returned: 0 in 1.181s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:42 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 1G Jul 03 16:37:42 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:42 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.906s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:42 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:42 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Deleted volume successfully. Jul 03 16:37:42 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-8343566b-9f5d-4bce-8f60-cd776161f0c6 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-5d7a8503-5e08-48a7-9d65-316a938a2fc1-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:43 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715" returned: 0 in 1.150s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:43 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715 Jul 03 16:37:43 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:43 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 1G" returned: 0 in 1.020s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2255ae54-c797-42c1-accb-7aed72c7024a -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:43 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2255ae54-c797-42c1-accb-7aed72c7024a -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 Jul 03 16:37:43 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:43 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-55919adb-1a7b-4671-91f6-8c82e7135715" returned: 0 in 0.832s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-55919adb-1a7b-4671-91f6-8c82e7135715" released by "delete_volume" :: held 2.067s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created reservations ['326f9c73-59b8-42f9-8a05-9f048fe852b9', 'fbc8163c-5d36-4b8b-8e0d-73e0443c1010', '97554ce1-8b73-40eb-9440-6f009f93d725', 'fe200cf9-e5f0-48d6-91fe-6ba5c9f86d24'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:44 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:44 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:44 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2255ae54-c797-42c1-accb-7aed72c7024a -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5" returned: 0 in 0.886s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:44 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 is being set with open permissions: ugo+rw Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:44 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 Jul 03 16:37:44 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:44 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.744s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:44 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Deleted volume successfully. Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7350cce2-4720-401c-9f73-0f5e37e19ce4 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-55919adb-1a7b-4671-91f6-8c82e7135715-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:45 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5" returned: 0 in 0.779s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:45 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.info Jul 03 16:37:45 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-12dceca9-3061-4bc8-8b43-794bcf2a576e-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-12dceca9-3061-4bc8-8b43-794bcf2a576e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-quobyte-12dceca9-3061-4bc8-8b43-794bcf2a576e" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-12dceca9-3061-4bc8-8b43-794bcf2a576e" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fe76b1-66e6-4461-b182-6276862bc9e1]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:45 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e Jul 03 16:37:45 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:45 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.info" returned: 0 in 0.837s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:45 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.info is being set with open permissions: ugo+rw Jul 03 16:37:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:45 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.info Jul 03 16:37:45 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:46 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e" returned: 0 in 0.983s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:46 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e Jul 03 16:37:46 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:46 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.info" returned: 0 in 0.712s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.563s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.385s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Creating offline snapshot d7fc47de-0c4e-4dfe-8682-c5ade381dab0 of volume 0557d1ab-a566-49ee-ab68-91a0854835ed {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:37:46 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-39a169f5-145b-4ff2-abf6-c287f5ba169c tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:37:46 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[662aad7d-e2fc-426d-b30f-8d96c3c40a71]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:46 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed Jul 03 16:37:46 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-6f554aeb-90ee-4241-816f-d0b0de98c8a5-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-6f554aeb-90ee-4241-816f-d0b0de98c8a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-2255ae54-c797-42c1-accb-7aed72c7024a" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-2255ae54-c797-42c1-accb-7aed72c7024a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-6f554aeb-90ee-4241-816f-d0b0de98c8a5" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-6f554aeb-90ee-4241-816f-d0b0de98c8a5" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Deleting offline snapshot 6f554aeb-90ee-4241-816f-d0b0de98c8a5 of volume 2255ae54-c797-42c1-accb-7aed72c7024a {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:37:47 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] snapshot_file for this snap is: volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12dceca9-3061-4bc8-8b43-794bcf2a576e" returned: 0 in 0.789s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-12dceca9-3061-4bc8-8b43-794bcf2a576e" released by "delete_volume" :: held 1.821s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f1eb43-583b-4438-a156-90f0a196ed2e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created reservations ['cab62057-a56f-4097-9e09-4f545eb9f336', '1ffd5263-c099-4832-8c05-d4e3972c6bf6', '4705f717-b39c-43c1-b885-2028b41cbd42', '620d89c9-cddf-4c74-9f50-71852940dfe6'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:47 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 Jul 03 16:37:47 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:47 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:47 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-faddf811-1e56-468e-a903-78f4bf5bc887-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-faddf811-1e56-468e-a903-78f4bf5bc887-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-quobyte-faddf811-1e56-468e-a903-78f4bf5bc887" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-faddf811-1e56-468e-a903-78f4bf5bc887" acquired by "delete_volume" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d212c147-ada3-42dc-9afb-f500edf69f02]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:47 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed" returned: 0 in 1.095s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:47 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 1G Jul 03 16:37:47 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:47 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887 Jul 03 16:37:47 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:48 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5" returned: 0 in 0.925s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2255ae54-c797-42c1-accb-7aed72c7024a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:37:48 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[406d413c-f2f9-4efb-97b9-6a299fd0d7c3]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:48 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.889s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:48 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:48 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Deleted volume successfully. Jul 03 16:37:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4d155bac-ea7c-458f-ab77-9fcbba7b33e5 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-12dceca9-3061-4bc8-8b43-794bcf2a576e-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:48 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a Jul 03 16:37:48 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:48 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887" returned: 0 in 0.975s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:48 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887 Jul 03 16:37:48 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:49 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 1G" returned: 0 in 1.225s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0557d1ab-a566-49ee-ab68-91a0854835ed -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:49 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0557d1ab-a566-49ee-ab68-91a0854835ed -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 Jul 03 16:37:49 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:49 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a" returned: 0 in 0.997s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:49 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 Jul 03 16:37:49 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:49 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-faddf811-1e56-468e-a903-78f4bf5bc887" returned: 0 in 0.768s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-faddf811-1e56-468e-a903-78f4bf5bc887" released by "delete_volume" :: held 1.797s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created reservations ['de031bee-0375-4663-b7d0-7f801d9f0342', 'd3608d37-ec2f-4855-aca8-66ccd6ae7980', '02bec012-f52c-4363-adfd-67eaca3dbedd', '6c744f0d-81e5-4b97-a49f-2729396d8c1e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:49 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:49 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-d2c9538c-c329-4a7e-ba11-a3282c820e68-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-d2c9538c-c329-4a7e-ba11-a3282c820e68-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:50 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0557d1ab-a566-49ee-ab68-91a0854835ed -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0" returned: 0 in 0.965s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:50 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 is being set with open permissions: ugo+rw Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:50 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 Jul 03 16:37:50 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-quobyte-d2c9538c-c329-4a7e-ba11-a3282c820e68" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-d2c9538c-c329-4a7e-ba11-a3282c820e68" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5196662-f6b5-49bb-b88d-7cfd1c8833e3]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:50 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 Jul 03 16:37:50 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:50 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5" returned: 0 in 1.098s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:50 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5 Jul 03 16:37:50 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:50 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.955s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:50 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Deleted volume successfully. Jul 03 16:37:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a1f5878d-65cf-4268-a9bf-9f787eb28753 tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-faddf811-1e56-468e-a903-78f4bf5bc887-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:51 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0" returned: 0 in 0.984s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:51 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.info Jul 03 16:37:51 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:51 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68" returned: 0 in 1.116s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:51 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68 Jul 03 16:37:51 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:51 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a.6f554aeb-90ee-4241-816f-d0b0de98c8a5" returned: 0 in 0.959s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-6f554aeb-90ee-4241-816f-d0b0de98c8a5" released by "_delete_snapshot" :: held 4.161s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-2255ae54-c797-42c1-accb-7aed72c7024a" released by "delete_snapshot" :: held 4.216s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:51 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Created reservations ['622fbc9b-2299-4fb4-a3a8-19444ffba42a', '52de776f-5ee8-4d3c-9495-3b316e4af977', '316bb11b-4520-4726-9435-3bff3617f41a', 'd3cd4325-205b-492e-94f9-0a319fc43584'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Delete snapshot completed successfully. Jul 03 16:37:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dca23f52-88f8-4e76-b071-b32f80da42cd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-6f554aeb-90ee-4241-816f-d0b0de98c8a5-delete_snapshot" released by "delete_snapshot" :: held 4.457s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:52 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.info" returned: 0 in 0.930s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:52 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.info is being set with open permissions: ugo+rw Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:52 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d2c9538c-c329-4a7e-ba11-a3282c820e68" returned: 0 in 0.777s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:52 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.info Jul 03 16:37:52 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-d2c9538c-c329-4a7e-ba11-a3282c820e68" released by "delete_volume" :: held 1.950s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created reservations ['00d4ed9c-8f6b-4715-8cfd-7742190d70cd', 'ced79c91-9340-41a3-afdb-e9cdda1722bd', '7985b337-8977-4958-b4c7-9e88a6b77981', '7ed39c7c-4a72-46fc-bf26-49c884e7b8b6'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-7981c7f5-cfd4-4af3-a4e7-d1143d26b109-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:52 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:52 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-7981c7f5-cfd4-4af3-a4e7-d1143d26b109-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-quobyte-876839b1-fd1d-4901-a421-f0f2bd2a53e6" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-876839b1-fd1d-4901-a421-f0f2bd2a53e6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-quobyte-7981c7f5-cfd4-4af3-a4e7-d1143d26b109" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-7981c7f5-cfd4-4af3-a4e7-d1143d26b109" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Deleting offline snapshot 7981c7f5-cfd4-4af3-a4e7-d1143d26b109 of volume 876839b1-fd1d-4901-a421-f0f2bd2a53e6 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] snapshot_file for this snap is: volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb45332-4c74-419d-975b-21b1894c535f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-2255ae54-c797-42c1-accb-7aed72c7024a-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-2255ae54-c797-42c1-accb-7aed72c7024a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:52 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 Jul 03 16:37:52 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-2255ae54-c797-42c1-accb-7aed72c7024a" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-2255ae54-c797-42c1-accb-7aed72c7024a" acquired by "delete_volume" :: waited 0.030s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9569d5b2-ca42-4e4b-958f-771b07912d72]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:53 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a Jul 03 16:37:53 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:53 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.info" returned: 0 in 1.161s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.495s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2b285ff2-98e9-440e-ab6d-4db99b77c9ac tempest-CinderUnicodeTest-1754415317 None] Create snapshot completed successfully Jul 03 16:37:53 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.047s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Deleted volume successfully. Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a58a92f8-ee0f-4436-bcee-afa41f99afbb tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-d2c9538c-c329-4a7e-ba11-a3282c820e68-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:53 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109" returned: 0 in 1.215s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9912b7c2-7e14-43a4-bb3f-ce3f52732741]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:53 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 Jul 03 16:37:53 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:53 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a" returned: 0 in 1.072s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:54 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a Jul 03 16:37:54 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "cinder-d7fc47de-0c4e-4dfe-8682-c5ade381dab0-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-d7fc47de-0c4e-4dfe-8682-c5ade381dab0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "cinder-quobyte-0557d1ab-a566-49ee-ab68-91a0854835ed" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-quobyte-0557d1ab-a566-49ee-ab68-91a0854835ed" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "cinder-quobyte-d7fc47de-0c4e-4dfe-8682-c5ade381dab0" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-quobyte-d7fc47de-0c4e-4dfe-8682-c5ade381dab0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Deleting offline snapshot d7fc47de-0c4e-4dfe-8682-c5ade381dab0 of volume 0557d1ab-a566-49ee-ab68-91a0854835ed {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] snapshot_file for this snap is: volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d235ef41-17d3-4d0b-a12a-f48cbd968b6b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:54 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 Jul 03 16:37:54 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:54 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6" returned: 0 in 0.986s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:54 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 Jul 03 16:37:54 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:54 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-2255ae54-c797-42c1-accb-7aed72c7024a" returned: 0 in 0.837s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-2255ae54-c797-42c1-accb-7aed72c7024a" released by "delete_volume" :: held 1.996s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Created reservations ['f008e75e-7977-4aab-bcd9-0ddbc83315e8', '28b4cfc0-44ab-4cc6-a41d-0c397c6b1600', 'e364679b-6a23-41d7-816e-671308ca46a9', '67b42d50-7ffc-42e6-b0ec-bb2d99eb9378'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:55 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:55 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:55 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0" returned: 0 in 0.993s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0557d1ab-a566-49ee-ab68-91a0854835ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[76969d60-fd22-4608-9916-9dc00f36def2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:55 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed Jul 03 16:37:55 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:55 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109" returned: 0 in 0.949s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:55 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109 Jul 03 16:37:55 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (9b0755da-5261-4457-9872-1c2bc76c0319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c864ea1-c025-4939-95fd-08c5027633e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c864ea1-c025-4939-95fd-08c5027633e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131717808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e520db-4c53-4623-a078-520667972e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:56Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141dacb2-2850-488f-9c53-679c62ac52cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141dacb2-2850-488f-9c53-679c62ac52cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382a8c7f-bb24-4de5-8a00-365d48db70ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (382a8c7f-bb24-4de5-8a00-365d48db70ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e520db-4c53-4623-a078-520667972e2f', 'volume_name': 'volume-34e520db-4c53-4623-a078-520667972e2f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a009fe-a215-4f92-9919-93f6840678d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a009fe-a215-4f92-9919-93f6840678d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93419f28-6452-4f0b-8b0d-91813d5b9118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:55 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Volume 34e520db-4c53-4623-a078-520667972e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e520db-4c53-4623-a078-520667972e2f', 'volume_size': 1} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131717808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e520db-4c53-4623-a078-520667972e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:37:56Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Creating volume 34e520db-4c53-4623-a078-520667972e2f {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:37:55 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:55 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f 1073741824 Jul 03 16:37:55 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:55 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.962s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:55 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:37:55 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Deleted volume successfully. Jul 03 16:37:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5c7bdde4-5a49-4b7e-82d8-74ace5e8bb91 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-2255ae54-c797-42c1-accb-7aed72c7024a-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:56 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed" returned: 0 in 1.103s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:56 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 Jul 03 16:37:56 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:56 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6.7981c7f5-cfd4-4af3-a4e7-d1143d26b109" returned: 0 in 0.899s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-7981c7f5-cfd4-4af3-a4e7-d1143d26b109" released by "_delete_snapshot" :: held 4.202s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-876839b1-fd1d-4901-a421-f0f2bd2a53e6" released by "delete_snapshot" :: held 4.234s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:56 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created reservations ['993547fb-d1a9-4b89-9aa6-12a6d0bb114b', '264e50b8-6159-463d-a29c-6b6fa3daf3e9', '8b7909b2-b408-4bb8-bd89-f95878b2e61b', '5fc7fe69-7bc5-45a9-a113-e17fdb183d26'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:56 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Delete snapshot completed successfully. Jul 03 16:37:56 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-80e4a19f-a2c8-4999-96c5-a61513dce40c tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-7981c7f5-cfd4-4af3-a4e7-d1143d26b109-delete_snapshot" released by "delete_snapshot" :: held 4.436s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:56 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f 1073741824" returned: 0 in 1.132s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:57 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f Jul 03 16:37:57 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:57 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0" returned: 0 in 0.912s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:57 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0 Jul 03 16:37:57 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-876839b1-fd1d-4901-a421-f0f2bd2a53e6-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-876839b1-fd1d-4901-a421-f0f2bd2a53e6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:57 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "cinder-quobyte-876839b1-fd1d-4901-a421-f0f2bd2a53e6" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f" returned: 0 in 0.788s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-876839b1-fd1d-4901-a421-f0f2bd2a53e6" acquired by "delete_volume" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93419f28-6452-4f0b-8b0d-91813d5b9118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e520db-4c53-4623-a078-520667972e2f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b762ba-6f3a-4010-9567-3106a2532a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2875cf01-9cc9-4051-8069-73da461f4907]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:57 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Volume volume-34e520db-4c53-4623-a078-520667972e2f (34e520db-4c53-4623-a078-520667972e2f): created successfully Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b762ba-6f3a-4010-9567-3106a2532a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (9b0755da-5261-4457-9872-1c2bc76c0319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:37:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7e1c5eb8-7fd7-420e-872b-d9eca4f86bfa tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:37:57 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed.d7fc47de-0c4e-4dfe-8682-c5ade381dab0" returned: 0 in 0.749s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:57 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 Jul 03 16:37:57 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-quobyte-d7fc47de-0c4e-4dfe-8682-c5ade381dab0" released by "_delete_snapshot" :: held 3.899s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-quobyte-0557d1ab-a566-49ee-ab68-91a0854835ed" released by "delete_snapshot" :: held 3.936s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Created reservations ['1d5b1d42-ccfd-46a6-bc55-68eeff314178', '73314585-a0fe-48c1-b8be-c1f8ef47b17a', '6fd18a4b-6f7f-4703-97f7-9f22f41e59b4', '4ff8e316-5945-42c9-8041-199ff0d160be'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Delete snapshot completed successfully. Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7e275ce1-8b27-4540-bfac-6e73f765a1a7 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-d7fc47de-0c4e-4dfe-8682-c5ade381dab0-delete_snapshot" released by "delete_snapshot" :: held 4.113s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "cinder-0557d1ab-a566-49ee-ab68-91a0854835ed-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-0557d1ab-a566-49ee-ab68-91a0854835ed-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "cinder-quobyte-0557d1ab-a566-49ee-ab68-91a0854835ed" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-quobyte-0557d1ab-a566-49ee-ab68-91a0854835ed" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2f29a9-4f94-4ad4-b60e-dcdf14d4de43]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:58 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed Jul 03 16:37:58 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:58 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6" returned: 0 in 0.918s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:58 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6 Jul 03 16:37:58 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot 230742d9-68c0-40db-8e6b-8ce45f7be815 of volume 34e520db-4c53-4623-a078-520667972e2f {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3beab07-6648-493b-aaed-82623b01beb8]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:59 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f Jul 03 16:37:59 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:59 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed" returned: 0 in 0.944s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:59 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed Jul 03 16:37:59 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:37:59 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-876839b1-fd1d-4901-a421-f0f2bd2a53e6" returned: 0 in 0.814s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-quobyte-876839b1-fd1d-4901-a421-f0f2bd2a53e6" released by "delete_volume" :: held 1.813s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Created reservations ['a91c1cb6-474d-4488-8631-b8eb2336b0fb', 'c306a5ca-81d8-4ec1-be9e-87dd9598227e', '543c8f47-6b2a-4f57-ad6f-2f497cbc7623', '4ec97f90-8411-4300-9c34-90673b3421c5'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:37:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:37:59 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:37:59 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:00 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f" returned: 0 in 1.021s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:00 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 1G Jul 03 16:38:00 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:00 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0557d1ab-a566-49ee-ab68-91a0854835ed" returned: 0 in 0.826s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-quobyte-0557d1ab-a566-49ee-ab68-91a0854835ed" released by "delete_volume" :: held 1.842s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Created reservations ['55a60dec-91df-49bf-a95d-4e2223929f44', '2250674e-50b3-426c-879f-d3595cd7e5da', '03589959-7388-49ac-8a54-016ea2af954b', 'ecb85aae-8345-484f-938d-639b511920c3'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:00 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:00 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "cinder-eb585011-fea2-440b-9bba-17f391ace2eb-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:00 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.919s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-eb585011-fea2-440b-9bba-17f391ace2eb-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:00 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Deleted volume successfully. Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-24d82ed2-62a6-4fe2-a082-13349f6e3a9f tempest-CreateVolumesFromSnapshotTest-1325841615 None] Lock "cinder-876839b1-fd1d-4901-a421-f0f2bd2a53e6-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "cinder-quobyte-eb585011-fea2-440b-9bba-17f391ace2eb" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-quobyte-eb585011-fea2-440b-9bba-17f391ace2eb" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f918d33b-d819-4cff-938e-202ff6ac2c2f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:01 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb Jul 03 16:38:01 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:01 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 1G" returned: 0 in 1.286s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e520db-4c53-4623-a078-520667972e2f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:01 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e520db-4c53-4623-a078-520667972e2f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 Jul 03 16:38:01 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:01 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.136s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:01 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:01 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Deleted volume successfully. Jul 03 16:38:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-587d247b-ecda-4dab-b5c8-a85326e51ce6 tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-0557d1ab-a566-49ee-ab68-91a0854835ed-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:01 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb" returned: 0 in 1.096s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:02 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb Jul 03 16:38:02 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:02 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e520db-4c53-4623-a078-520667972e2f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815" returned: 0 in 0.986s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:02 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 is being set with open permissions: ugo+rw Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:02 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 Jul 03 16:38:02 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:02 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-eb585011-fea2-440b-9bba-17f391ace2eb" returned: 0 in 0.773s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-quobyte-eb585011-fea2-440b-9bba-17f391ace2eb" released by "delete_volume" :: held 1.932s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Created reservations ['793e8c1d-5332-43f3-bee3-9f39d235ba6b', '09f4c692-6bef-415b-a2e8-a5504d510fdb', '5b934dd0-f955-4738-a19f-3121f1b0ccd3', 'bd885afd-0d62-43de-8d3b-d065d17d0747'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:02 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:03 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:03 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815" returned: 0 in 0.903s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:03 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.info Jul 03 16:38:03 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:03 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.998s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:03 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Deleted volume successfully. Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3812044d-f88d-41bd-8c56-ddf0418861aa tempest-CinderUnicodeTest-1754415317 None] Lock "cinder-eb585011-fea2-440b-9bba-17f391ace2eb-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:04 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.info" returned: 0 in 1.016s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:04 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.info is being set with open permissions: ugo+rw Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:04 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.info Jul 03 16:38:04 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (5123854e-9c06-4e20-9f40-35288eb8ec7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a19a27f-8596-47d6-afa8-25942b017151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a19a27f-8596-47d6-afa8-25942b017151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855736530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d74a8a-cc04-4be3-99a8-0a43b1263f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:04Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7d39d9-db27-463b-8133-23bd372cc011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7d39d9-db27-463b-8133-23bd372cc011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fd47ff-c7ef-4114-a3b0-ffb91321099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fd47ff-c7ef-4114-a3b0-ffb91321099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12d74a8a-cc04-4be3-99a8-0a43b1263f24', 'volume_name': 'volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a90551-b5da-43f9-9930-546a594eb28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a90551-b5da-43f9-9930-546a594eb28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dee2726-6c22-425b-a1cc-75fa3a6d7214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:04 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume 12d74a8a-cc04-4be3-99a8-0a43b1263f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24', 'volume_size': 1} Jul 03 16:38:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:05 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.info" returned: 0 in 0.802s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.127s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.649s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855736530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d74a8a-cc04-4be3-99a8-0a43b1263f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:04Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Creating volume 12d74a8a-cc04-4be3-99a8-0a43b1263f24 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:05 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:05 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 1073741824 Jul 03 16:38:05 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:05 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-be16298b-05fe-45f8-97ce-a6502bc8378c tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-230742d9-68c0-40db-8e6b-8ce45f7be815-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-230742d9-68c0-40db-8e6b-8ce45f7be815-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-34e520db-4c53-4623-a078-520667972e2f" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-34e520db-4c53-4623-a078-520667972e2f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-230742d9-68c0-40db-8e6b-8ce45f7be815" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-230742d9-68c0-40db-8e6b-8ce45f7be815" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Deleting offline snapshot 230742d9-68c0-40db-8e6b-8ce45f7be815 of volume 34e520db-4c53-4623-a078-520667972e2f {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] snapshot_file for this snap is: volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2147a57e-b80f-4701-a5ba-71000d988b23]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:05 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 Jul 03 16:38:05 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:06 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 1073741824" returned: 0 in 1.188s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:06 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 Jul 03 16:38:06 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:06 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815" returned: 0 in 1.019s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34e520db-4c53-4623-a078-520667972e2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:38:06 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[946fb102-eb8c-418a-9aa0-a4df5f3e0a42]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:06 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f Jul 03 16:38:06 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:07 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24" returned: 0 in 0.827s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dee2726-6c22-425b-a1cc-75fa3a6d7214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a75d8c-53bd-4fba-ac47-f4b4d448eb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:07 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 (12d74a8a-cc04-4be3-99a8-0a43b1263f24): created successfully Jul 03 16:38:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a75d8c-53bd-4fba-ac47-f4b4d448eb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (5123854e-9c06-4e20-9f40-35288eb8ec7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:07 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4c5bdfdb-d91f-4b4d-9e79-3b91d622ca11 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created volume successfully. Jul 03 16:38:07 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f" returned: 0 in 1.025s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:07 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 Jul 03 16:38:07 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (7994a639-d674-4e4e-b899-873c274add2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf99a968-51c0-491e-8e3d-6e635e43b8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf99a968-51c0-491e-8e3d-6e635e43b8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148085168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f7eba9-48d8-4cdb-96a9-2a4b61c8210c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:08Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75be3a1e-73ef-4e1e-baca-7d30c00e8f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75be3a1e-73ef-4e1e-baca-7d30c00e8f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691f13ac-cbe9-4dc1-bd17-5d83f912929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691f13ac-cbe9-4dc1-bd17-5d83f912929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f7eba9-48d8-4cdb-96a9-2a4b61c8210c', 'volume_name': 'volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab06872-59fd-4790-9ab9-e5f1d9781396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab06872-59fd-4790-9ab9-e5f1d9781396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b96164-5f52-40bf-b23b-81fe9f8993ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume 21f7eba9-48d8-4cdb-96a9-2a4b61c8210c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c', 'volume_size': 1} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148085168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f7eba9-48d8-4cdb-96a9-2a4b61c8210c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:08Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Creating volume 21f7eba9-48d8-4cdb-96a9-2a4b61c8210c {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:08 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:08 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c 1073741824 Jul 03 16:38:08 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:08 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815" returned: 0 in 1.001s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:08 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815 Jul 03 16:38:08 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (be2913e5-7dac-45d6-83f0-e65cfdd020ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308fe911-5f92-4275-a475-599abd8e5731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308fe911-5f92-4275-a475-599abd8e5731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1266173646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8843116b-09b0-496e-a070-64375feac537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:09Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756c14a1-3171-4c0f-906a-9a9f4eb7b8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756c14a1-3171-4c0f-906a-9a9f4eb7b8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051ababf-7c13-4f8b-9ac2-2678d7e00e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051ababf-7c13-4f8b-9ac2-2678d7e00e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8843116b-09b0-496e-a070-64375feac537', 'volume_name': 'volume-8843116b-09b0-496e-a070-64375feac537', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07af966f-752a-4699-9497-1801e246945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07af966f-752a-4699-9497-1801e246945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac00553-ce69-42d0-81ed-ca3b70cf5809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:08 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume 8843116b-09b0-496e-a070-64375feac537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8843116b-09b0-496e-a070-64375feac537', 'volume_size': 1} Jul 03 16:38:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (18817d65-8dec-4ce0-9b19-aafeefa45fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d27e5ff-f1a7-463e-beb3-0547096ca9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d27e5ff-f1a7-463e-beb3-0547096ca9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-153139271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5044eb60-16d1-44f8-8b63-f5dac717e151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:09Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292b64cf-97d8-4827-bb47-7943f656fcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292b64cf-97d8-4827-bb47-7943f656fcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6322cd85-c2c3-433c-828b-cd1db70aa2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6322cd85-c2c3-433c-828b-cd1db70aa2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5044eb60-16d1-44f8-8b63-f5dac717e151', 'volume_name': 'volume-5044eb60-16d1-44f8-8b63-f5dac717e151', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231e82b9-83bb-4386-869f-4df4c66a56cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231e82b9-83bb-4386-869f-4df4c66a56cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8ae4bc-0974-4f96-86ef-bbd466e5d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:09 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume 5044eb60-16d1-44f8-8b63-f5dac717e151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5044eb60-16d1-44f8-8b63-f5dac717e151', 'volume_size': 1} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (02de34b5-0674-4ac1-be09-3ff455bc26e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35566b7-a4b8-43c7-8a3a-11aefe965b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:09 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f.230742d9-68c0-40db-8e6b-8ce45f7be815" returned: 0 in 1.193s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35566b7-a4b8-43c7-8a3a-11aefe965b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-86580089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1daab85-98fd-4cdd-a8ad-40bc7606fc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:10Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f407de-4dc9-4e02-8965-67688d47dc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f407de-4dc9-4e02-8965-67688d47dc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d62af2-015b-4b8c-90c9-a53cbd062f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d62af2-015b-4b8c-90c9-a53cbd062f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1daab85-98fd-4cdd-a8ad-40bc7606fc1f', 'volume_name': 'volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8f585a-73c0-4b7b-b959-eb2f7d01a6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8f585a-73c0-4b7b-b959-eb2f7d01a6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8436032-8a90-4e4b-af7a-113d0806403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume e1daab85-98fd-4cdd-a8ad-40bc7606fc1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f', 'volume_size': 1} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-230742d9-68c0-40db-8e6b-8ce45f7be815" released by "_delete_snapshot" :: held 4.485s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-34e520db-4c53-4623-a078-520667972e2f" released by "delete_snapshot" :: held 4.516s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:10 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c 1073741824" returned: 0 in 1.501s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:10 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c Jul 03 16:38:10 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Created reservations ['89a88814-e5c3-47fc-afcf-b471980ca92e', '3bd465b7-98d0-4f53-bd7c-ba16f51fac3b', '5b9d7b25-1477-43f7-aa31-b860af2814ef', '0861d93f-3199-400b-9b28-e862752fec83'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:10 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Delete snapshot completed successfully. Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a2c1a256-f4a0-482a-8780-afdd54915ab4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-230742d9-68c0-40db-8e6b-8ce45f7be815-delete_snapshot" released by "delete_snapshot" :: held 4.770s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (1a5dbad9-aede-4691-ae79-2ad114aa7528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aded74e-72bc-471a-b7a1-9a4d5a902cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aded74e-72bc-471a-b7a1-9a4d5a902cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850194638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11bfb74-596d-4edd-8917-c600e0c05897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:10Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016619bb-367d-40ef-bfd5-51f9bf4e12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016619bb-367d-40ef-bfd5-51f9bf4e12ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81cbda6c-6e92-4411-81e0-45f1ad140ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81cbda6c-6e92-4411-81e0-45f1ad140ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b11bfb74-596d-4edd-8917-c600e0c05897', 'volume_name': 'volume-b11bfb74-596d-4edd-8917-c600e0c05897', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbedd84-518c-4959-8b99-558f9f8bfd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbedd84-518c-4959-8b99-558f9f8bfd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbac4a8-e078-4d3c-af4d-25ca74517393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume b11bfb74-596d-4edd-8917-c600e0c05897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b11bfb74-596d-4edd-8917-c600e0c05897', 'volume_size': 1} Jul 03 16:38:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:11 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c" returned: 0 in 0.798s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] <== create_volume: return (2372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.376s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.075s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1266173646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8843116b-09b0-496e-a070-64375feac537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:09Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Creating volume 8843116b-09b0-496e-a070-64375feac537 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:11 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b96164-5f52-40bf-b23b-81fe9f8993ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:11 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537 1073741824 Jul 03 16:38:11 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cab0326-160a-4a94-9b2b-bfe9b92a9426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:11 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c (21f7eba9-48d8-4cdb-96a9-2a4b61c8210c): created successfully Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cab0326-160a-4a94-9b2b-bfe9b92a9426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (7994a639-d674-4e4e-b899-873c274add2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:11 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-90c06230-d8c5-4d0b-9375-3e4066ba40c3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created volume successfully. Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-34e520db-4c53-4623-a078-520667972e2f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Lock "cinder-34e520db-4c53-4623-a078-520667972e2f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-34e520db-4c53-4623-a078-520667972e2f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-34e520db-4c53-4623-a078-520667972e2f" acquired by "delete_volume" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[506af127-a8ca-4e0d-b9ee-b2dfd6263339]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:11 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f Jul 03 16:38:11 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:11 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537 1073741824" returned: 0 in 0.934s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:12 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537 Jul 03 16:38:12 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:12 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f" returned: 0 in 0.929s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:12 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f Jul 03 16:38:12 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:12 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537" returned: 0 in 0.731s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.262s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-153139271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5044eb60-16d1-44f8-8b63-f5dac717e151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:09Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Creating volume 5044eb60-16d1-44f8-8b63-f5dac717e151 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:12 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:12 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151 1073741824 Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac00553-ce69-42d0-81ed-ca3b70cf5809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8843116b-09b0-496e-a070-64375feac537', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:12 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9ee3c1-2103-4174-8e40-2877d244d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:12 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume volume-8843116b-09b0-496e-a070-64375feac537 (8843116b-09b0-496e-a070-64375feac537): created successfully Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9ee3c1-2103-4174-8e40-2877d244d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (be2913e5-7dac-45d6-83f0-e65cfdd020ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-456eae92-df59-48f6-a449-21ab59e3ffea tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created volume successfully. Jul 03 16:38:13 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-34e520db-4c53-4623-a078-520667972e2f" returned: 0 in 0.731s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-34e520db-4c53-4623-a078-520667972e2f" released by "delete_volume" :: held 1.734s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Created reservations ['efe8a8c7-2f36-48dc-ad15-eaf8d40174e5', '3862abf9-12c3-4f7e-b539-46d1557149bd', '18368d41-33e9-4e55-954f-f75d6e727860', '7441388b-10ff-4f91-93a7-830abfa674e0'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:13 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:13 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:13 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151 1073741824" returned: 0 in 1.218s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:14 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151 Jul 03 16:38:14 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:14 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.009s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:14 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Deleted volume successfully. Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-cdc1e575-9483-41c9-b6b0-536287768bca tempest-ProjectMemberTests-1209623427 None] Lock "cinder-34e520db-4c53-4623-a078-520667972e2f-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (5530d1f5-e247-4f28-87b1-9dce11e4c9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6757d423-2334-440c-a9b9-7af9690b89b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6757d423-2334-440c-a9b9-7af9690b89b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398358154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8de633-26a2-417c-89ce-4a507286af1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:14Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589ee701-b4d6-434c-9a2b-62ac76682052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589ee701-b4d6-434c-9a2b-62ac76682052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fb2dbd-cae4-4579-a097-b31b8d948b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fb2dbd-cae4-4579-a097-b31b8d948b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8de633-26a2-417c-89ce-4a507286af1f', 'volume_name': 'volume-3b8de633-26a2-417c-89ce-4a507286af1f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e57a44-f511-4153-b54d-de2d259a83b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e57a44-f511-4153-b54d-de2d259a83b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8766d1cc-02a0-46e0-a86d-4e3f167fdd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:14 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Volume 3b8de633-26a2-417c-89ce-4a507286af1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8de633-26a2-417c-89ce-4a507286af1f', 'volume_size': 1} Jul 03 16:38:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:15 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151" returned: 0 in 0.947s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.926s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-86580089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1daab85-98fd-4cdd-a8ad-40bc7606fc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:10Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Creating volume e1daab85-98fd-4cdd-a8ad-40bc7606fc1f {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:15 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:15 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f 1073741824 Jul 03 16:38:15 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8ae4bc-0974-4f96-86ef-bbd466e5d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5044eb60-16d1-44f8-8b63-f5dac717e151', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88175a55-2691-4c87-9248-fbc3e1b245ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:15 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume volume-5044eb60-16d1-44f8-8b63-f5dac717e151 (5044eb60-16d1-44f8-8b63-f5dac717e151): created successfully Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88175a55-2691-4c87-9248-fbc3e1b245ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:15 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (18817d65-8dec-4ce0-9b19-aafeefa45fa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-96e68126-d55d-4ace-b8e4-596a37ba633a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created volume successfully. Jul 03 16:38:16 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f 1073741824" returned: 0 in 1.036s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:16 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f Jul 03 16:38:16 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:16 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f" returned: 0 in 0.734s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.231s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850194638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11bfb74-596d-4edd-8917-c600e0c05897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167608c1bafe46349deb1f20e97adc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:10Z,use_quota=True,user_id='a737c4161a774c9e9f7f1de4548b74d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Creating volume b11bfb74-596d-4edd-8917-c600e0c05897 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:16 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8436032-8a90-4e4b-af7a-113d0806403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:16 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897 1073741824 Jul 03 16:38:16 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef194a10-783b-4329-9fe8-5fa3a91edf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:16 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f (e1daab85-98fd-4cdd-a8ad-40bc7606fc1f): created successfully Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef194a10-783b-4329-9fe8-5fa3a91edf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:16 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (02de34b5-0674-4ac1-be09-3ff455bc26e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:16 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-16aed4a7-af3d-4c42-8467-f77ef1dba08e tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created volume successfully. Jul 03 16:38:17 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897 1073741824" returned: 0 in 1.040s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:17 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897 Jul 03 16:38:17 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:18 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897" returned: 0 in 0.895s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.280s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398358154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8de633-26a2-417c-89ce-4a507286af1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:14Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Creating volume 3b8de633-26a2-417c-89ce-4a507286af1f {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:18 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:18 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f 1073741824 Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbac4a8-e078-4d3c-af4d-25ca74517393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b11bfb74-596d-4edd-8917-c600e0c05897', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:18 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aea0a5c-75ff-4952-9723-1ed9344aecce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:18 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Volume volume-b11bfb74-596d-4edd-8917-c600e0c05897 (b11bfb74-596d-4edd-8917-c600e0c05897): created successfully Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aea0a5c-75ff-4952-9723-1ed9344aecce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Flow 'volume_create_manager' (1a5dbad9-aede-4691-ae79-2ad114aa7528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4be50da9-4548-4bfd-98de-95f1167ebd7a tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created volume successfully. Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:19 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:19 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-b11bfb74-596d-4edd-8917-c600e0c05897-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-b11bfb74-596d-4edd-8917-c600e0c05897-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-quobyte-b11bfb74-596d-4edd-8917-c600e0c05897" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-b11bfb74-596d-4edd-8917-c600e0c05897" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b552924e-ccd3-4fad-b883-dbd828f32253]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:19 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897 Jul 03 16:38:19 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:19 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.951s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:38:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:38:20 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f 1073741824" returned: 0 in 1.219s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:20 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f Jul 03 16:38:20 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:20 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897" returned: 0 in 0.914s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:20 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897 Jul 03 16:38:20 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:21 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f" returned: 0 in 0.889s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8766d1cc-02a0-46e0-a86d-4e3f167fdd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8de633-26a2-417c-89ce-4a507286af1f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3241b6ea-5fe1-43ca-95f4-81359b4bca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:21 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Volume volume-3b8de633-26a2-417c-89ce-4a507286af1f (3b8de633-26a2-417c-89ce-4a507286af1f): created successfully Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3241b6ea-5fe1-43ca-95f4-81359b4bca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (5530d1f5-e247-4f28-87b1-9dce11e4c9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0adc32e0-5441-4703-b3c8-31a55817d377 tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:38:21 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-b11bfb74-596d-4edd-8917-c600e0c05897" returned: 0 in 0.742s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-b11bfb74-596d-4edd-8917-c600e0c05897" released by "delete_volume" :: held 1.707s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created reservations ['c21e56b7-2d2d-4e09-a5c9-c9da8e3dd98d', '863d7ebd-99b7-4591-975f-1477cab7f066', 'de7af396-342f-4d35-a64d-440e240d616e', '4283151f-5059-4c8e-b0c7-1c73c4314439'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:21 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:21 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-quobyte-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4c511b-f87a-463d-ad22-98a4634cff48]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:22 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f Jul 03 16:38:22 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot 2dacc014-fa1b-489e-9ed3-d92917967514 of volume 3b8de633-26a2-417c-89ce-4a507286af1f {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3956882-6a53-47d2-acf7-3f03fb651a9d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:22 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.873s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:22 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Deleted volume successfully. Jul 03 16:38:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-af102870-34fe-40d0-89d2-97350907c4e6 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-b11bfb74-596d-4edd-8917-c600e0c05897-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:22 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f Jul 03 16:38:22 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:23 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f" returned: 0 in 0.970s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:23 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f Jul 03 16:38:23 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:23 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f" returned: 0 in 0.991s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:23 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 1G Jul 03 16:38:23 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:23 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f" returned: 0 in 0.775s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f" released by "delete_volume" :: held 1.833s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created reservations ['d5ff599d-ead3-46ed-9568-26acd0cba26a', 'f2df2fc0-93a5-4493-b064-9e105b6f82e8', '5bee567d-99bb-465d-8b1b-fe1b6654f650', '7d7744ae-fe98-4f7a-be3a-47bb83a22fac'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:24 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:24 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-5044eb60-16d1-44f8-8b63-f5dac717e151-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-5044eb60-16d1-44f8-8b63-f5dac717e151-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-quobyte-5044eb60-16d1-44f8-8b63-f5dac717e151" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-5044eb60-16d1-44f8-8b63-f5dac717e151" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[349284ae-3a1a-466a-8654-ed3789ac30a2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:24 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151 Jul 03 16:38:24 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:24 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 1G" returned: 0 in 1.212s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8de633-26a2-417c-89ce-4a507286af1f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:24 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8de633-26a2-417c-89ce-4a507286af1f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 Jul 03 16:38:24 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:25 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.942s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:25 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Deleted volume successfully. Jul 03 16:38:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b58f2434-65a8-498a-abf9-935ebd9ee600 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-e1daab85-98fd-4cdd-a8ad-40bc7606fc1f-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:25 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151" returned: 0 in 0.929s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:25 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151 Jul 03 16:38:25 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:25 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8de633-26a2-417c-89ce-4a507286af1f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514" returned: 0 in 0.987s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:25 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 is being set with open permissions: ugo+rw Jul 03 16:38:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:25 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 Jul 03 16:38:25 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:26 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5044eb60-16d1-44f8-8b63-f5dac717e151" returned: 0 in 0.820s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-5044eb60-16d1-44f8-8b63-f5dac717e151" released by "delete_volume" :: held 1.814s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created reservations ['9bed1813-f042-471f-9bf7-cc7f1b9356ef', '3cacb52d-4b8c-4097-b44d-27b9f61c474f', '782f96eb-ef7b-494d-b8d9-c5d23662e051', '8a1d810f-67e1-4e60-beb0-1c0d6b48c8d4'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:26 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514" returned: 0 in 0.740s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:26 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:26 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:26 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.info Jul 03 16:38:26 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-8843116b-09b0-496e-a070-64375feac537-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-8843116b-09b0-496e-a070-64375feac537-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-quobyte-8843116b-09b0-496e-a070-64375feac537" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-8843116b-09b0-496e-a070-64375feac537" acquired by "delete_volume" :: waited 0.031s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[347e346d-9c62-461d-b18f-2fa342b8b70c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:27 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537 Jul 03 16:38:27 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:27 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.036s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:27 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:27 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Deleted volume successfully. Jul 03 16:38:27 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-38f8e729-3a3a-4f7e-b63c-5b71bacaecfd tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-5044eb60-16d1-44f8-8b63-f5dac717e151-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:27 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.info" returned: 0 in 1.109s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:27 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.info is being set with open permissions: ugo+rw Jul 03 16:38:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:27 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.info Jul 03 16:38:27 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:27 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537" returned: 0 in 1.049s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:27 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537 Jul 03 16:38:27 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:28 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.info" returned: 0 in 0.894s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.085s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=125,cinder:UPDATE=175,cinder:INSERT=43,cinder:DELETE=17 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:38:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6220087c-c59b-4123-af4c-450e811d6f26 tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-2dacc014-fa1b-489e-9ed3-d92917967514-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-2dacc014-fa1b-489e-9ed3-d92917967514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-3b8de633-26a2-417c-89ce-4a507286af1f" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-3b8de633-26a2-417c-89ce-4a507286af1f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-2dacc014-fa1b-489e-9ed3-d92917967514" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:28 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-2dacc014-fa1b-489e-9ed3-d92917967514" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Deleting offline snapshot 2dacc014-fa1b-489e-9ed3-d92917967514 of volume 3b8de633-26a2-417c-89ce-4a507286af1f {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] snapshot_file for this snap is: volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-8843116b-09b0-496e-a070-64375feac537" returned: 0 in 0.894s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dbf464-ce6d-4004-b766-31db3b497b1f]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-8843116b-09b0-496e-a070-64375feac537" released by "delete_volume" :: held 2.027s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:28 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created reservations ['7ed4d77e-57ed-4fe1-8e9a-4607f72e18b2', 'd99fd4fc-5543-4584-9e73-c84545d9f760', 'f78db6cf-455d-4bdf-866e-c9beab52c22b', 'ef1dee50-8502-4410-8356-2406b4e5477f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:28 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 Jul 03 16:38:28 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:29 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:29 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=180,cinder:DELETE=15,cinder:SELECT=122,cinder:INSERT=46 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-quobyte-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c" acquired by "delete_volume" :: waited 0.028s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c92bba5-ec69-4db4-acc3-df8f364ac013]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:29 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c Jul 03 16:38:29 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:30 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514" returned: 0 in 1.414s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b8de633-26a2-417c-89ce-4a507286af1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9411d9-91a6-4980-a2ce-410c358e80e3]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:30 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.267s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Flow 'volume_create_manager' (82c3938d-6200-49f6-bca0-c0f38548d444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8980323-d466-4a0a-853e-b3fae7266988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:30 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Deleted volume successfully. Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8980323-d466-4a0a-853e-b3fae7266988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503918226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f2fb16-24af-4450-92f1-3d97a8603f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3aa6c24c3b84673a72b9391b2a8ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:30Z,use_quota=True,user_id='76a9acfb1d6c4778b43adf98ba3f24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c628734e-2bb8-441f-b518-2e5daf8893aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c628734e-2bb8-441f-b518-2e5daf8893aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f40394-cb8c-4d79-9c6c-365fd396cdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f40394-cb8c-4d79-9c6c-365fd396cdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f2fb16-24af-4450-92f1-3d97a8603f19', 'volume_name': 'volume-87f2fb16-24af-4450-92f1-3d97a8603f19', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71423e0-696b-48b6-8e5a-36c6f9d633dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71423e0-696b-48b6-8e5a-36c6f9d633dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba5b18d-ea18-4169-8f63-27d1f790c93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:30 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Volume 87f2fb16-24af-4450-92f1-3d97a8603f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f2fb16-24af-4450-92f1-3d97a8603f19', 'volume_size': 1} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503918226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f2fb16-24af-4450-92f1-3d97a8603f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3aa6c24c3b84673a72b9391b2a8ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:30Z,use_quota=True,user_id='76a9acfb1d6c4778b43adf98ba3f24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Creating volume 87f2fb16-24af-4450-92f1-3d97a8603f19 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:30 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:30 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a48f736b-042d-478d-a3e1-89b0da91cfd3 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-8843116b-09b0-496e-a070-64375feac537-delete_volume" released by "delete_volume" :: held 3.800s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:30 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:30 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19 1073741824 Jul 03 16:38:30 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:30 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c" returned: 0 in 1.254s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:30 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c Jul 03 16:38:30 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:31 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f" returned: 0 in 1.102s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:31 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 Jul 03 16:38:31 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:31 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c" returned: 0 in 0.838s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c" released by "delete_volume" :: held 2.183s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created reservations ['57ebec18-42f1-48a9-a941-703686ae7991', '21121cee-ed34-4ea2-8995-5920eb66d142', 'ba4df79e-a6e3-46fd-bcf5-aceddb1bf78d', '5dd0110a-c19c-4dc5-a371-279e3d4b3a6d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:31 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19 1073741824" returned: 0 in 1.196s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:31 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:31 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:31 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19 Jul 03 16:38:31 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:32 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19" returned: 0 in 0.733s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:32 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514" returned: 0 in 1.082s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba5b18d-ea18-4169-8f63-27d1f790c93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f2fb16-24af-4450-92f1-3d97a8603f19', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80af19d2-86de-45dc-afb8-e87f316e6eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:32 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514 Jul 03 16:38:32 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:32 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Volume volume-87f2fb16-24af-4450-92f1-3d97a8603f19 (87f2fb16-24af-4450-92f1-3d97a8603f19): created successfully Jul 03 16:38:32 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80af19d2-86de-45dc-afb8-e87f316e6eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Flow 'volume_create_manager' (82c3938d-6200-49f6-bca0-c0f38548d444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.868s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Deleted volume successfully. Jul 03 16:38:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-37956c2a-b7e0-4610-8f8b-d0c2b2feadb1 tempest-ProjectReaderTests-428115479 None] Created volume successfully. Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-3cafa688-76ff-43d6-9f06-79bf7a7a7d41 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-21f7eba9-48d8-4cdb-96a9-2a4b61c8210c-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-12d74a8a-cc04-4be3-99a8-0a43b1263f24-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-12d74a8a-cc04-4be3-99a8-0a43b1263f24-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "cinder-quobyte-12d74a8a-cc04-4be3-99a8-0a43b1263f24" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-12d74a8a-cc04-4be3-99a8-0a43b1263f24" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ab02e6-4ab6-4a56-aa52-e2c12e6ce06e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:32 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 Jul 03 16:38:32 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:33 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f.2dacc014-fa1b-489e-9ed3-d92917967514" returned: 0 in 0.912s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-2dacc014-fa1b-489e-9ed3-d92917967514" released by "_delete_snapshot" :: held 4.648s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-3b8de633-26a2-417c-89ce-4a507286af1f" released by "delete_snapshot" :: held 4.680s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Created reservations ['abfcabfc-d584-420c-9beb-2fda6af2b2a8', '4608d47e-b41d-46e0-ae15-ea8820032ad6', '7605c822-7101-4783-8d38-b0b139333f8e', 'ffda7d53-bcfd-4ce0-8171-d80ae8229f28'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Delete snapshot completed successfully. Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-a9e1d39b-0376-45f8-b6c0-e1269f1d7e77 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-2dacc014-fa1b-489e-9ed3-d92917967514-delete_snapshot" released by "delete_snapshot" :: held 4.893s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:33 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Acquiring lock "cinder-87f2fb16-24af-4450-92f1-3d97a8603f19-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24" returned: 0 in 0.927s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Lock "cinder-87f2fb16-24af-4450-92f1-3d97a8603f19-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:33 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24 Jul 03 16:38:33 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Acquiring lock "cinder-quobyte-87f2fb16-24af-4450-92f1-3d97a8603f19" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Lock "cinder-quobyte-87f2fb16-24af-4450-92f1-3d97a8603f19" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ec503b-c078-4157-9894-9c4c9f448c1d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:34 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19 Jul 03 16:38:34 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-3b8de633-26a2-417c-89ce-4a507286af1f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-3b8de633-26a2-417c-89ce-4a507286af1f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-3b8de633-26a2-417c-89ce-4a507286af1f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-3b8de633-26a2-417c-89ce-4a507286af1f" acquired by "delete_volume" :: waited 0.034s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4787ab8-3f1d-4d8d-b9dd-592293025e95]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:34 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f Jul 03 16:38:34 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:34 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-12d74a8a-cc04-4be3-99a8-0a43b1263f24" returned: 0 in 0.833s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-quobyte-12d74a8a-cc04-4be3-99a8-0a43b1263f24" released by "delete_volume" :: held 1.821s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Created reservations ['34cf2fd9-fd52-4513-a426-7643c69eb790', '64e242ac-2f25-4898-b009-a8b9f87502f7', '6f4bbe6b-15cc-4314-ad8a-e415420a44b4', '66566860-6db4-4506-8314-d54c5ec6d8a7'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:34 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:34 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:35 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19" returned: 0 in 1.135s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:35 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19 Jul 03 16:38:35 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:35 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f" returned: 0 in 1.126s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:35 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f Jul 03 16:38:35 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:35 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.009s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:35 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:35 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Deleted volume successfully. Jul 03 16:38:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d019ad23-0815-44a6-aedd-8c0a20fa2642 tempest-CreateVolumesFromSourceVolumeTest-1138332276 None] Lock "cinder-12d74a8a-cc04-4be3-99a8-0a43b1263f24-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:36 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-87f2fb16-24af-4450-92f1-3d97a8603f19" returned: 0 in 0.902s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Lock "cinder-quobyte-87f2fb16-24af-4450-92f1-3d97a8603f19" released by "delete_volume" :: held 2.101s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Created reservations ['2117eb98-8678-4311-93fd-8009a35a8c59', '2f972979-3af4-4f29-a111-3a96c094d59a', 'cfe1fb72-4942-4042-892f-656b9391d891', '13dd0cd9-bba7-4e3a-a452-3d002cdae451'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:36 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:36 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:36 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3b8de633-26a2-417c-89ce-4a507286af1f" returned: 0 in 1.161s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-3b8de633-26a2-417c-89ce-4a507286af1f" released by "delete_volume" :: held 2.369s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Created reservations ['a0d8295d-eac8-42d7-90d4-c469e7b119a3', '17d88a42-bad2-43b0-a590-5b3cf659e50e', 'e277548c-0d59-4f48-bb58-7052fc351af4', '3deb8e93-0e04-4664-925e-68ab0474d815'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:36 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:36 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:37 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.110s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:37 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Deleted volume successfully. Jul 03 16:38:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c373fce6-94e8-4dd9-bf65-9c74861b3a24 tempest-ProjectReaderTests-428115479 None] Lock "cinder-87f2fb16-24af-4450-92f1-3d97a8603f19-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:38 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.331s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Deleted volume successfully. Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Flow 'volume_create_manager' (94f48840-90df-4e31-be26-5ac8ffffdd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86c5c1d-ce3a-45e3-89d9-1ac77a1aab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-128a0016-31da-4fcb-968c-73b26bb3e07f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-3b8de633-26a2-417c-89ce-4a507286af1f-delete_volume" released by "delete_volume" :: held 4.129s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86c5c1d-ce3a-45e3-89d9-1ac77a1aab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939933506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bda266-40fd-47d1-aeff-512947499134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3aa6c24c3b84673a72b9391b2a8ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:38Z,use_quota=True,user_id='76a9acfb1d6c4778b43adf98ba3f24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da496992-431d-42b1-9154-f158c3d24dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da496992-431d-42b1-9154-f158c3d24dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c45c48-e9ae-458f-a265-80716ee1e27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c45c48-e9ae-458f-a265-80716ee1e27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80bda266-40fd-47d1-aeff-512947499134', 'volume_name': 'volume-80bda266-40fd-47d1-aeff-512947499134', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6b55b4-435c-4ec0-929e-b3d63c9161b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6b55b4-435c-4ec0-929e-b3d63c9161b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad416b0-0a50-4325-9e0e-1fde4d0afc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Volume 80bda266-40fd-47d1-aeff-512947499134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80bda266-40fd-47d1-aeff-512947499134', 'volume_size': 1} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939933506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bda266-40fd-47d1-aeff-512947499134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3aa6c24c3b84673a72b9391b2a8ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:38Z,use_quota=True,user_id='76a9acfb1d6c4778b43adf98ba3f24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Creating volume 80bda266-40fd-47d1-aeff-512947499134 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:38 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:38 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134 1073741824 Jul 03 16:38:38 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (565e9d49-59c3-4825-b39a-bf2373afd8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c192908-274c-41f2-b57a-ce37e9c4b8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c192908-274c-41f2-b57a-ce37e9c4b8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511379495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b33494d-daac-4d15-be87-95e047352cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:38Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf12c6b8-d1ef-4077-9921-6f5096f3d31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf12c6b8-d1ef-4077-9921-6f5096f3d31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53808370-a405-4934-ad1e-22f93a05469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53808370-a405-4934-ad1e-22f93a05469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b33494d-daac-4d15-be87-95e047352cb1', 'volume_name': 'volume-4b33494d-daac-4d15-be87-95e047352cb1', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c42f41-18c8-4063-a3b3-b195340e6771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c42f41-18c8-4063-a3b3-b195340e6771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c133b4-4d0f-4773-a808-3482b8b72105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Volume 4b33494d-daac-4d15-be87-95e047352cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b33494d-daac-4d15-be87-95e047352cb1', 'volume_size': 1} Jul 03 16:38:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:39 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134 1073741824" returned: 0 in 1.130s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:39 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134 Jul 03 16:38:39 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:40 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134" returned: 0 in 0.902s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.879s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511379495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b33494d-daac-4d15-be87-95e047352cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:38Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Creating volume 4b33494d-daac-4d15-be87-95e047352cb1 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:40 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad416b0-0a50-4325-9e0e-1fde4d0afc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bda266-40fd-47d1-aeff-512947499134', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72f9944-572a-4fd7-b6c6-7168dcf7fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:40 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1 1073741824 Jul 03 16:38:40 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:40 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Volume volume-80bda266-40fd-47d1-aeff-512947499134 (80bda266-40fd-47d1-aeff-512947499134): created successfully Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72f9944-572a-4fd7-b6c6-7168dcf7fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:40 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Flow 'volume_create_manager' (94f48840-90df-4e31-be26-5ac8ffffdd2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:40 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b4e421fd-de69-4c5d-bfa4-b2387429d6f5 tempest-ProjectReaderTests-428115479 None] Created volume successfully. Jul 03 16:38:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Acquiring lock "cinder-80bda266-40fd-47d1-aeff-512947499134-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Lock "cinder-80bda266-40fd-47d1-aeff-512947499134-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Acquiring lock "cinder-quobyte-80bda266-40fd-47d1-aeff-512947499134" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:41 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Lock "cinder-quobyte-80bda266-40fd-47d1-aeff-512947499134" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:41 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dab7b62-e914-49f7-8a17-a047cb6639fa]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:41 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134 Jul 03 16:38:41 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:41 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1 1073741824" returned: 0 in 1.304s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:41 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1 Jul 03 16:38:41 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:42 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134" returned: 0 in 1.081s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:42 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134 Jul 03 16:38:42 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:42 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1" returned: 0 in 0.912s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:42 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c133b4-4d0f-4773-a808-3482b8b72105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b33494d-daac-4d15-be87-95e047352cb1', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bce2cb5-cd59-4c32-b574-d6373624a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:42 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Volume volume-4b33494d-daac-4d15-be87-95e047352cb1 (4b33494d-daac-4d15-be87-95e047352cb1): created successfully Jul 03 16:38:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bce2cb5-cd59-4c32-b574-d6373624a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:42 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (565e9d49-59c3-4825-b39a-bf2373afd8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:42 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4c663f68-0155-4034-87c2-1998a2014a0c tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:38:43 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80bda266-40fd-47d1-aeff-512947499134" returned: 0 in 0.840s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Lock "cinder-quobyte-80bda266-40fd-47d1-aeff-512947499134" released by "delete_volume" :: held 1.993s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:43 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Created reservations ['c28987c7-ae61-4665-971f-dec0500263f1', 'a846f84f-a3da-4e81-8a55-fde0fef522a2', '79762e05-9d5a-4044-bf83-cbb9efac8554', 'e55e9708-8f6e-477c-a4cf-198a8fc3c403'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:43 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:43 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot 95319735-2c27-4716-bc01-abaa88918546 of volume 4b33494d-daac-4d15-be87-95e047352cb1 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fecf44-ba0a-40f5-bbd8-a7ebce77da02]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:44 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1 Jul 03 16:38:44 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Flow 'volume_create_manager' (4e6423c4-898d-4459-a8ec-375133cdcb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d41091d-9c7d-494c-9d69-3d01bd187345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d41091d-9c7d-494c-9d69-3d01bd187345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286939595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a53e35e-19e1-44a4-8565-95b38f94b241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3aa6c24c3b84673a72b9391b2a8ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:45Z,use_quota=True,user_id='76a9acfb1d6c4778b43adf98ba3f24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc4ba03-1f8d-4b18-b654-8ea31e558de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc4ba03-1f8d-4b18-b654-8ea31e558de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4729e119-0325-4993-9b09-0b74c9e9b620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4729e119-0325-4993-9b09-0b74c9e9b620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a53e35e-19e1-44a4-8565-95b38f94b241', 'volume_name': 'volume-4a53e35e-19e1-44a4-8565-95b38f94b241', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a83e4c3-2d2f-420c-be9b-78053295b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a83e4c3-2d2f-420c-be9b-78053295b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661aa375-b168-47e5-aefa-db5627650d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:44 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Volume 4a53e35e-19e1-44a4-8565-95b38f94b241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a53e35e-19e1-44a4-8565-95b38f94b241', 'volume_size': 1} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:44 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 1.112s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:44 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Deleted volume successfully. Jul 03 16:38:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-4611253e-2419-4e19-8344-77ae589aefb6 tempest-ProjectReaderTests-428115479 None] Lock "cinder-80bda266-40fd-47d1-aeff-512947499134-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:45 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1" returned: 0 in 1.088s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:45 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546 1G Jul 03 16:38:45 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:46 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546 1G" returned: 0 in 1.024s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b33494d-daac-4d15-be87-95e047352cb1 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:46 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b33494d-daac-4d15-be87-95e047352cb1 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546 Jul 03 16:38:46 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:47 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b33494d-daac-4d15-be87-95e047352cb1 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546" returned: 0 in 0.990s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:47 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546 is being set with open permissions: ugo+rw Jul 03 16:38:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:47 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546 Jul 03 16:38:47 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:48 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.95319735-2c27-4716-bc01-abaa88918546" returned: 0 in 0.804s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:48 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.info Jul 03 16:38:48 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:49 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.info" returned: 0 in 0.706s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:49 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.info is being set with open permissions: ugo+rw Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:49 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.info Jul 03 16:38:49 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:49 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4b33494d-daac-4d15-be87-95e047352cb1.info" returned: 0 in 0.761s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.520s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.159s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286939595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a53e35e-19e1-44a4-8565-95b38f94b241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3aa6c24c3b84673a72b9391b2a8ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:45Z,use_quota=True,user_id='76a9acfb1d6c4778b43adf98ba3f24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Creating volume 4a53e35e-19e1-44a4-8565-95b38f94b241 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:49 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:49 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241 1073741824 Jul 03 16:38:49 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-73e86932-3ba8-46ad-b3f8-1cdbcccff25d tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:38:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-eace8df3-3caf-40f7-991a-29cf7d21c972 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-95319735-2c27-4716-bc01-abaa88918546-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-eace8df3-3caf-40f7-991a-29cf7d21c972 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-95319735-2c27-4716-bc01-abaa88918546-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:50 devstack cinder-volume[86659]: INFO cinder.message.api [None req-eace8df3-3caf-40f7-991a-29cf7d21c972 tempest-ProjectMemberTests-1209623427 None] Creating message record for request_id = req-eace8df3-3caf-40f7-991a-29cf7d21c972 Jul 03 16:38:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-eace8df3-3caf-40f7-991a-29cf7d21c972 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-95319735-2c27-4716-bc01-abaa88918546-delete_snapshot" released by "delete_snapshot" :: held 0.055s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server [None req-eace8df3-3caf-40f7-991a-29cf7d21c972 tempest-ProjectMemberTests-1209623427 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 16:38:50 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server Jul 03 16:38:51 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241 1073741824" returned: 0 in 1.127s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:51 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241 Jul 03 16:38:51 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:51 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241" returned: 0 in 0.802s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661aa375-b168-47e5-aefa-db5627650d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a53e35e-19e1-44a4-8565-95b38f94b241', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c15fd7-9ff4-40d1-bfc0-2e6421f5fd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Volume volume-4a53e35e-19e1-44a4-8565-95b38f94b241 (4a53e35e-19e1-44a4-8565-95b38f94b241): created successfully Jul 03 16:38:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c15fd7-9ff4-40d1-bfc0-2e6421f5fd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Flow 'volume_create_manager' (4e6423c4-898d-4459-a8ec-375133cdcb74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0f213dbb-7668-41d9-b7b1-c1c6c73a0552 tempest-ProjectReaderTests-428115479 None] Created volume successfully. Jul 03 16:38:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Acquiring lock "cinder-4a53e35e-19e1-44a4-8565-95b38f94b241-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Lock "cinder-4a53e35e-19e1-44a4-8565-95b38f94b241-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Acquiring lock "cinder-quobyte-4a53e35e-19e1-44a4-8565-95b38f94b241" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Lock "cinder-quobyte-4a53e35e-19e1-44a4-8565-95b38f94b241" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:52 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d26a1-f8ce-4d8e-b955-9306182382b8]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:52 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241 Jul 03 16:38:52 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:53 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (d8efcf19-4318-4fd8-9fd8-dbfda9157f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e80f9c-331b-45db-a739-56f569643027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241" returned: 0 in 0.921s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e80f9c-331b-45db-a739-56f569643027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095403975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36017dd4-c63a-4930-b02e-a54a2bfb36bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:53Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:53 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241 Jul 03 16:38:53 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992c19ca-7070-42ea-9556-1b20a391e367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992c19ca-7070-42ea-9556-1b20a391e367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ec7a8b-e330-42d7-b392-eca94a59f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ec7a8b-e330-42d7-b392-eca94a59f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36017dd4-c63a-4930-b02e-a54a2bfb36bf', 'volume_name': 'volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2ba3ff-5d15-4a2a-91d9-64f3f6af8e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2ba3ff-5d15-4a2a-91d9-64f3f6af8e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950051f0-3c86-4fba-b738-928e90402aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:53 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Volume 36017dd4-c63a-4930-b02e-a54a2bfb36bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf', 'volume_size': 1} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095403975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36017dd4-c63a-4930-b02e-a54a2bfb36bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:53Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Creating volume 36017dd4-c63a-4930-b02e-a54a2bfb36bf {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:53 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:53 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf 1073741824 Jul 03 16:38:53 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:54 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-4a53e35e-19e1-44a4-8565-95b38f94b241" returned: 0 in 0.756s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Lock "cinder-quobyte-4a53e35e-19e1-44a4-8565-95b38f94b241" released by "delete_volume" :: held 1.732s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Created reservations ['0d51f349-69b9-4578-bff5-f2186be8bb5a', '60042a70-db62-4df1-9210-41429658504f', 'b65d561b-af11-45f4-8518-335bb075290e', 'd5e0acc5-09c5-439a-9ac0-3da39f07d622'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:54 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:38:54 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:54 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf 1073741824" returned: 0 in 0.929s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:54 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf Jul 03 16:38:54 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:54 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.751s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:54 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:38:54 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Deleted volume successfully. Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-457e2072-8f1b-4ed4-987f-401f2660f30e tempest-ProjectReaderTests-428115479 None] Lock "cinder-4a53e35e-19e1-44a4-8565-95b38f94b241-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:38:55 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Flow 'volume_create_manager' (26be9c52-22f8-40e0-9ac0-8d3fa7ce007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d05454c-7b25-482f-a9f9-0770017850bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf" returned: 0 in 0.819s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d05454c-7b25-482f-a9f9-0770017850bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177687275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5bc67f-0f49-4ac2-abfa-141e22f49050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3aa6c24c3b84673a72b9391b2a8ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:55Z,use_quota=True,user_id='76a9acfb1d6c4778b43adf98ba3f24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be143b7-1283-4056-911b-5a3ce31cd607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be143b7-1283-4056-911b-5a3ce31cd607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7bdabd-44be-451a-8109-f4366e1bd74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7bdabd-44be-451a-8109-f4366e1bd74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5bc67f-0f49-4ac2-abfa-141e22f49050', 'volume_name': 'volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000b8a32-c7f3-4ed0-a177-3f9aa0c17dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000b8a32-c7f3-4ed0-a177-3f9aa0c17dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd609993-dba7-4da8-ba35-9533db6e1d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:55 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Volume dc5bc67f-0f49-4ac2-abfa-141e22f49050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050', 'volume_size': 1} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177687275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5bc67f-0f49-4ac2-abfa-141e22f49050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3aa6c24c3b84673a72b9391b2a8ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:38:55Z,use_quota=True,user_id='76a9acfb1d6c4778b43adf98ba3f24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Creating volume dc5bc67f-0f49-4ac2-abfa-141e22f49050 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:38:55 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950051f0-3c86-4fba-b738-928e90402aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:55 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 1073741824 Jul 03 16:38:55 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb3d596-167d-470c-9c5c-d74aaa1021ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:55 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Volume volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf (36017dd4-c63a-4930-b02e-a54a2bfb36bf): created successfully Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb3d596-167d-470c-9c5c-d74aaa1021ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:55 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (d8efcf19-4318-4fd8-9fd8-dbfda9157f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:55 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-a010ac11-7b2e-45bd-a314-3f06b4e44279 tempest-ProjectReaderTests-1936949216 None] Created volume successfully. Jul 03 16:38:56 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 1073741824" returned: 0 in 1.005s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:56 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 Jul 03 16:38:56 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:38:57 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050" returned: 0 in 0.787s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.412s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Creating offline snapshot bd011289-fa6a-4526-947c-f9d08b86bb9f of volume 36017dd4-c63a-4930-b02e-a54a2bfb36bf {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd609993-dba7-4da8-ba35-9533db6e1d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ae11d2-39ef-45e0-9891-87c1d7eba2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e061ded-6cbb-4094-abb9-20609c9d45f3]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:57 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Volume volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 (dc5bc67f-0f49-4ac2-abfa-141e22f49050): created successfully Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ae11d2-39ef-45e0-9891-87c1d7eba2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:38:57 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Flow 'volume_create_manager' (26be9c52-22f8-40e0-9ac0-8d3fa7ce007e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:38:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-df584f4c-270f-4bd8-b19c-839e1998d335 tempest-ProjectReaderTests-428115479 None] Created volume successfully. Jul 03 16:38:57 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf Jul 03 16:38:57 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:58 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf" returned: 0 in 0.987s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:58 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f 1G Jul 03 16:38:58 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Acquiring lock "cinder-dc5bc67f-0f49-4ac2-abfa-141e22f49050-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Lock "cinder-dc5bc67f-0f49-4ac2-abfa-141e22f49050-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Acquiring lock "cinder-quobyte-dc5bc67f-0f49-4ac2-abfa-141e22f49050" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:38:58 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Lock "cinder-quobyte-dc5bc67f-0f49-4ac2-abfa-141e22f49050" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:38:58 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d680578-6889-46c9-a7c2-a9349dbfd765]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:38:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:58 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 Jul 03 16:38:58 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:59 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f 1G" returned: 0 in 1.017s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:59 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f Jul 03 16:38:59 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:59 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050" returned: 0 in 1.045s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:38:59 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050 Jul 03 16:38:59 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:38:59 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jul 03 16:38:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f" returned: 0 in 0.864s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:38:59 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f is being set with open permissions: ugo+rw Jul 03 16:38:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:00 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f Jul 03 16:39:00 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:00 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-dc5bc67f-0f49-4ac2-abfa-141e22f49050" returned: 0 in 0.748s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Lock "cinder-quobyte-dc5bc67f-0f49-4ac2-abfa-141e22f49050" released by "delete_volume" :: held 1.842s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Created reservations ['53aaf201-fea1-461f-9a7d-7687b164bbfb', 'f96de6c6-4aa4-42c8-8537-d07c8945bf20', '0fb091a7-e8b1-4bf1-9ecd-63cd4a037c8d', 'fce8f0ba-a574-4f71-8af1-aa316bbdb038'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:00 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:39:00 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:00 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f" returned: 0 in 0.801s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:00 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.info Jul 03 16:39:00 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:01 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.748s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:01 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:39:01 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Deleted volume successfully. Jul 03 16:39:01 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f8641eb1-0062-4cf5-958a-dd9f41b69617 tempest-ProjectReaderTests-428115479 None] Lock "cinder-dc5bc67f-0f49-4ac2-abfa-141e22f49050-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:01 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.info" returned: 0 in 0.766s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:01 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.info is being set with open permissions: ugo+rw Jul 03 16:39:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:01 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.info Jul 03 16:39:01 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:02 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.info" returned: 0 in 0.913s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.489s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:02 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-052fd6ca-a665-4b10-83f9-927172956ac8 tempest-ProjectReaderTests-1936949216 None] Create snapshot completed successfully Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-bd011289-fa6a-4526-947c-f9d08b86bb9f-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Lock "cinder-bd011289-fa6a-4526-947c-f9d08b86bb9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-36017dd4-c63a-4930-b02e-a54a2bfb36bf" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-36017dd4-c63a-4930-b02e-a54a2bfb36bf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-bd011289-fa6a-4526-947c-f9d08b86bb9f" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-bd011289-fa6a-4526-947c-f9d08b86bb9f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Deleting offline snapshot bd011289-fa6a-4526-947c-f9d08b86bb9f of volume 36017dd4-c63a-4930-b02e-a54a2bfb36bf {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] snapshot_file for this snap is: volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18282d2-fb37-4d16-b8a3-0a3242c98095]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:39:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:03 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f Jul 03 16:39:03 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:04 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f" returned: 0 in 0.967s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:04 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:39:04 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fc4511-9bc8-416c-81c0-1828a7665905]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:39:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:04 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf Jul 03 16:39:04 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:05 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf" returned: 0 in 0.920s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:05 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f Jul 03 16:39:05 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:06 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f" returned: 0 in 0.800s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:06 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f Jul 03 16:39:06 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:06 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf.bd011289-fa6a-4526-947c-f9d08b86bb9f" returned: 0 in 0.799s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-bd011289-fa6a-4526-947c-f9d08b86bb9f" released by "_delete_snapshot" :: held 3.599s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-36017dd4-c63a-4930-b02e-a54a2bfb36bf" released by "delete_snapshot" :: held 3.624s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Created reservations ['a8e8c28c-1080-43c0-9a1d-34faafa63fbd', 'edc773fc-bc53-49ee-9284-c2d39d5b7af4', '311feb2f-2da2-4fe3-90af-bb674c8f49be', '60e71fa8-907b-4625-9c0e-66bfa9ce660d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:39:07 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Delete snapshot completed successfully. Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ee724f40-26e7-478a-bbb6-3c6a32befa3e tempest-ProjectReaderTests-1936949216 None] Lock "cinder-bd011289-fa6a-4526-947c-f9d08b86bb9f-delete_snapshot" released by "delete_snapshot" :: held 3.817s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-36017dd4-c63a-4930-b02e-a54a2bfb36bf-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Lock "cinder-36017dd4-c63a-4930-b02e-a54a2bfb36bf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-36017dd4-c63a-4930-b02e-a54a2bfb36bf" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-36017dd4-c63a-4930-b02e-a54a2bfb36bf" acquired by "delete_volume" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e63f5b5-075b-4925-81d4-a36307820f92]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:39:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:07 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf Jul 03 16:39:07 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:08 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf" returned: 0 in 0.834s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:08 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf Jul 03 16:39:08 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:09 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-36017dd4-c63a-4930-b02e-a54a2bfb36bf" returned: 0 in 0.694s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-36017dd4-c63a-4930-b02e-a54a2bfb36bf" released by "delete_volume" :: held 1.589s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:09 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Created reservations ['207f4a42-2658-4ffc-bcf7-910fe12f5c91', 'd7540138-135b-4c3b-9d07-2546d0ab60d1', '157918da-18c6-418b-940c-18bba9a5528c', 'a4abb750-997b-4bc9-b93a-3aa96437444d'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:39:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:39:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:39:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:09 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:39:09 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:10 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.665s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:39:10 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Deleted volume successfully. Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d85f17e6-707c-4230-85ea-421e8320fece tempest-ProjectReaderTests-1936949216 None] Lock "cinder-36017dd4-c63a-4930-b02e-a54a2bfb36bf-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (ac7d90e8-3ce7-48cb-b689-78bd4483d1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cb7093-dca2-42e1-9bbc-aeb8c2fbaf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cb7093-dca2-42e1-9bbc-aeb8c2fbaf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213818982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ae5933-9ec3-444b-9fbb-d757ae4f24c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:39:10Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece10e66-179e-43b1-bf9f-e9e51cd50827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece10e66-179e-43b1-bf9f-e9e51cd50827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd48e8a-cdf1-49fd-afb1-a8a1596e60ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd48e8a-cdf1-49fd-afb1-a8a1596e60ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ae5933-9ec3-444b-9fbb-d757ae4f24c0', 'volume_name': 'volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38826569-28f5-4778-ba18-e01a82520efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38826569-28f5-4778-ba18-e01a82520efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8231a59-70f1-4b3d-b295-787bd53516f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:10 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Volume d5ae5933-9ec3-444b-9fbb-d757ae4f24c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0', 'volume_size': 1} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213818982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ae5933-9ec3-444b-9fbb-d757ae4f24c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:39:10Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Creating volume d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:39:10 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:39:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:10 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 1073741824 Jul 03 16:39:10 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:11 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 1073741824" returned: 0 in 0.906s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:11 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 Jul 03 16:39:11 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:12 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" returned: 0 in 0.674s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8231a59-70f1-4b3d-b295-787bd53516f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57d689f-3dcb-4791-9415-ac64263f730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:12 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Volume volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 (d5ae5933-9ec3-444b-9fbb-d757ae4f24c0): created successfully Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57d689f-3dcb-4791-9415-ac64263f730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (ac7d90e8-3ce7-48cb-b689-78bd4483d1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:39:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7c1b1829-7d07-418e-b3d0-4d4ad438fda0 tempest-ProjectReaderTests-1936949216 None] Created volume successfully. Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Creating offline snapshot c9521233-efe3-4ab0-8417-9d7203474d06 of volume d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1878e558-8cd0-4940-a600-895a2f925191]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:39:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:12 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 Jul 03 16:39:12 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:13 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" returned: 0 in 0.837s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:13 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 1G Jul 03 16:39:13 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:14 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 1G" returned: 0 in 0.906s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:14 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 Jul 03 16:39:14 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:15 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06" returned: 0 in 0.928s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:15 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 is being set with open permissions: ugo+rw Jul 03 16:39:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:15 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 Jul 03 16:39:15 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:16 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06" returned: 0 in 0.817s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:16 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.info Jul 03 16:39:16 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:17 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.info" returned: 0 in 0.787s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:17 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.info is being set with open permissions: ugo+rw Jul 03 16:39:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:17 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.info Jul 03 16:39:17 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:17 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.info" returned: 0 in 0.680s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.055s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:17 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6d0a310a-09f7-4c8a-a89a-3db11902c9bf tempest-ProjectReaderTests-1936949216 None] Create snapshot completed successfully Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-c9521233-efe3-4ab0-8417-9d7203474d06-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-c9521233-efe3-4ab0-8417-9d7203474d06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" acquired by "delete_snapshot" :: waited 0.083s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-c9521233-efe3-4ab0-8417-9d7203474d06" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-c9521233-efe3-4ab0-8417-9d7203474d06" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Deleting offline snapshot c9521233-efe3-4ab0-8417-9d7203474d06 of volume d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] snapshot_file for this snap is: volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[949a0669-a017-4554-9875-0a9fcbc4dec4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:18 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 Jul 03 16:39:18 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:19 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:39:19 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:19 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06" returned: 0 in 0.914s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:39:19 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58c7771-5cc0-43d4-bd06-78245387aa0e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:39:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:19 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 Jul 03 16:39:19 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:19 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.862s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:39:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:39:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:39:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:39:20 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" returned: 0 in 0.909s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:20 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 Jul 03 16:39:20 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:20 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06" returned: 0 in 0.883s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:20 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06 Jul 03 16:39:20 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:21 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0.c9521233-efe3-4ab0-8417-9d7203474d06" returned: 0 in 0.805s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-c9521233-efe3-4ab0-8417-9d7203474d06" released by "_delete_snapshot" :: held 3.641s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" released by "delete_snapshot" :: held 3.671s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:21 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Created reservations ['2dda9b5d-8bd9-4514-91d3-df5e3ee3be95', '39b77c76-7742-4fcc-8f09-288f7cb484e1', '324cc884-a90f-4be8-adba-145e70f0a923', '229a0cbb-b56c-4de8-97b0-a71e800e0790'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:39:21 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Delete snapshot completed successfully. Jul 03 16:39:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-dcdd017d-691d-47d8-bcbd-174b76bbbd63 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-c9521233-efe3-4ab0-8417-9d7203474d06-delete_snapshot" released by "delete_snapshot" :: held 3.925s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" acquired by "delete_volume" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:22 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06347a1-3653-4dd8-a59d-77109d1a9ced]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:39:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:22 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 Jul 03 16:39:22 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:23 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" returned: 0 in 0.938s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:23 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0 Jul 03 16:39:23 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:24 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" returned: 0 in 0.751s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0" released by "delete_volume" :: held 1.764s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:24 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Created reservations ['cd6a9a82-b3ae-42a2-b1b4-eb0936b6a5e9', 'c2fcb712-b78a-46fb-ba47-6397497cf58b', '991eea2b-73e0-42e6-8d12-6b972451f3f2', '5574d38e-96d3-4ca8-9c70-de2d77942ae9'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:39:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:39:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:39:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:24 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:39:24 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:39:25 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (5f0e6033-4155-4883-9d1a-a56e99b54d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc471586-4801-4824-ac0a-4efb63972df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.832s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:39:25 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Deleted volume successfully. Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc471586-4801-4824-ac0a-4efb63972df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518303445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92affe9f-2ceb-4a96-af55-6deb10bca36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:39:25Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce70a6d-9438-4288-8609-d28f920519a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce70a6d-9438-4288-8609-d28f920519a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df1f3dd-735a-4737-8319-09b7b5b3af1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df1f3dd-735a-4737-8319-09b7b5b3af1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92affe9f-2ceb-4a96-af55-6deb10bca36b', 'volume_name': 'volume-92affe9f-2ceb-4a96-af55-6deb10bca36b', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff9ebff-b8aa-4b74-86e9-2f6c905637e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff9ebff-b8aa-4b74-86e9-2f6c905637e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0acfaf63-8a4c-4ae7-83db-80ef9fb13ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:25 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Volume 92affe9f-2ceb-4a96-af55-6deb10bca36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92affe9f-2ceb-4a96-af55-6deb10bca36b', 'volume_size': 1} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518303445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92affe9f-2ceb-4a96-af55-6deb10bca36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:39:25Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Creating volume 92affe9f-2ceb-4a96-af55-6deb10bca36b {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:39:25 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:25 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b 1073741824 Jul 03 16:39:25 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:25 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7ab2c1a6-adab-41ca-8415-9ac7f2bc5f08 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-d5ae5933-9ec3-444b-9fbb-d757ae4f24c0-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:26 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b 1073741824" returned: 0 in 1.077s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:26 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b Jul 03 16:39:26 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:27 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b" returned: 0 in 0.887s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:39:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0acfaf63-8a4c-4ae7-83db-80ef9fb13ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92affe9f-2ceb-4a96-af55-6deb10bca36b', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3626937-8097-4b44-9446-32d1ee78a1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:39:27 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Volume volume-92affe9f-2ceb-4a96-af55-6deb10bca36b (92affe9f-2ceb-4a96-af55-6deb10bca36b): created successfully Jul 03 16:39:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3626937-8097-4b44-9446-32d1ee78a1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:39:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (5f0e6033-4155-4883-9d1a-a56e99b54d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:39:27 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d0f3a574-1d6a-42e9-9268-c96700b64e07 tempest-ProjectReaderTests-1936949216 None] Created volume successfully. Jul 03 16:39:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:39:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:39:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Creating offline snapshot 729ba26f-489f-41f7-8e73-8a5e445be7bf of volume 92affe9f-2ceb-4a96-af55-6deb10bca36b {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:39:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc1d0ef-5f82-4548-b0cf-2a3fdc659437]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:39:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:28 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b Jul 03 16:39:28 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:29 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b" returned: 0 in 1.017s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:29 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf 1G Jul 03 16:39:29 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:30 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf 1G" returned: 0 in 1.067s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92affe9f-2ceb-4a96-af55-6deb10bca36b -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:30 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92affe9f-2ceb-4a96-af55-6deb10bca36b -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf Jul 03 16:39:30 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:31 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92affe9f-2ceb-4a96-af55-6deb10bca36b -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf" returned: 0 in 0.941s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:31 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf is being set with open permissions: ugo+rw Jul 03 16:39:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:31 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf Jul 03 16:39:31 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:32 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.729ba26f-489f-41f7-8e73-8a5e445be7bf" returned: 0 in 0.838s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:32 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=115,cinder:SELECT=91,cinder:INSERT=31,cinder:DELETE=12 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:39:32 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=81,cinder:INSERT=30,cinder:UPDATE=130,cinder:DELETE=9 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:39:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:32 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.info Jul 03 16:39:32 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:33 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.info" returned: 0 in 0.803s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:33 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.info is being set with open permissions: ugo+rw Jul 03 16:39:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:39:33 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.info Jul 03 16:39:33 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:39:34 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 03 16:39:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-92affe9f-2ceb-4a96-af55-6deb10bca36b.info" returned: 0 in 0.765s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:39:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.533s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:39:34 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-732629ca-4b98-4b19-a472-d3f648123747 tempest-ProjectReaderTests-1936949216 None] Create snapshot completed successfully Jul 03 16:39:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d55ae4d1-6978-4150-a0f0-0f347d9ce9fb tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-729ba26f-489f-41f7-8e73-8a5e445be7bf-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:39:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d55ae4d1-6978-4150-a0f0-0f347d9ce9fb tempest-ProjectReaderTests-1936949216 None] Lock "cinder-729ba26f-489f-41f7-8e73-8a5e445be7bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:39:34 devstack cinder-volume[86659]: INFO cinder.message.api [None req-d55ae4d1-6978-4150-a0f0-0f347d9ce9fb tempest-ProjectReaderTests-1936949216 None] Creating message record for request_id = req-d55ae4d1-6978-4150-a0f0-0f347d9ce9fb Jul 03 16:39:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d55ae4d1-6978-4150-a0f0-0f347d9ce9fb tempest-ProjectReaderTests-1936949216 None] Lock "cinder-729ba26f-489f-41f7-8e73-8a5e445be7bf-delete_snapshot" released by "delete_snapshot" :: held 0.045s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server [None req-d55ae4d1-6978-4150-a0f0-0f347d9ce9fb tempest-ProjectReaderTests-1936949216 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 16:39:34 devstack cinder-volume[86659]: ERROR oslo_messaging.rpc.server Jul 03 16:39:46 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:39:46 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:DELETE=1,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:40:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:40:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:40:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:40:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:40:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:40:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:40:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:40:19 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:40:19 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:40:19 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Jul 03 16:40:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.720s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:40:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:40:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:40:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:40:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:41:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:41:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:41:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:41:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:41:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:41:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:41:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:41:19 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:41:19 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:41:19 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 03 16:41:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.726s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:41:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:41:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:41:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:41:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:41:46 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:41:46 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=1 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (6bfad9ce-4775-4047-b5a6-a4a40e9ee752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cc2ad9-d5e4-4cd9-9b94-98d4c5f380a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cc2ad9-d5e4-4cd9-9b94-98d4c5f380a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1289474996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33440b5-6987-41aa-a7fb-ebc603d70da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:08Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a751b6fe-f638-4f0e-8536-8d2003e3f707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a751b6fe-f638-4f0e-8536-8d2003e3f707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30e9389-37bc-4a37-bd2c-bc6674a1fb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30e9389-37bc-4a37-bd2c-bc6674a1fb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33440b5-6987-41aa-a7fb-ebc603d70da2', 'volume_name': 'volume-e33440b5-6987-41aa-a7fb-ebc603d70da2', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35535b6a-b9ff-4e50-ad39-71f8357bd7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35535b6a-b9ff-4e50-ad39-71f8357bd7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da891c9-6eb8-479c-9f8f-54544b1f935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:07 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Volume e33440b5-6987-41aa-a7fb-ebc603d70da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33440b5-6987-41aa-a7fb-ebc603d70da2', 'volume_size': 1} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1289474996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33440b5-6987-41aa-a7fb-ebc603d70da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:08Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Creating volume e33440b5-6987-41aa-a7fb-ebc603d70da2 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:42:07 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:42:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:07 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 1073741824 Jul 03 16:42:07 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:08 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 1073741824" returned: 0 in 1.016s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:09 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 Jul 03 16:42:09 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:09 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2" returned: 0 in 0.743s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:42:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da891c9-6eb8-479c-9f8f-54544b1f935d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33440b5-6987-41aa-a7fb-ebc603d70da2', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff87129c-7274-4cde-854f-bb971637e981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:09 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Volume volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 (e33440b5-6987-41aa-a7fb-ebc603d70da2): created successfully Jul 03 16:42:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff87129c-7274-4cde-854f-bb971637e981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (6bfad9ce-4775-4047-b5a6-a4a40e9ee752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:09 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-1fed0912-5ced-4085-bf35-427eaccabc46 tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:42:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot b82bd8f0-5bf5-49cf-8a77-db04a217940f of volume e33440b5-6987-41aa-a7fb-ebc603d70da2 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:42:10 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af0dd4d-4411-4d8a-99d2-6aa1ee629ce6]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:10 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 Jul 03 16:42:10 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:10 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2" returned: 0 in 0.836s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:11 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f 1G Jul 03 16:42:11 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:11 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f 1G" returned: 0 in 0.930s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:11 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f Jul 03 16:42:11 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:12 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f" returned: 0 in 0.811s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:12 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f is being set with open permissions: ugo+rw Jul 03 16:42:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:12 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f Jul 03 16:42:12 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:13 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f" returned: 0 in 0.725s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:13 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.info Jul 03 16:42:13 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:14 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.info" returned: 0 in 0.767s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:14 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.info is being set with open permissions: ugo+rw Jul 03 16:42:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:14 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.info Jul 03 16:42:14 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:14 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.info" returned: 0 in 0.698s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.879s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d16434d7-cc72-428e-b7ba-0b12efe064d3 tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-b82bd8f0-5bf5-49cf-8a77-db04a217940f-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-b82bd8f0-5bf5-49cf-8a77-db04a217940f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-e33440b5-6987-41aa-a7fb-ebc603d70da2" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-e33440b5-6987-41aa-a7fb-ebc603d70da2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-b82bd8f0-5bf5-49cf-8a77-db04a217940f" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-b82bd8f0-5bf5-49cf-8a77-db04a217940f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Deleting offline snapshot b82bd8f0-5bf5-49cf-8a77-db04a217940f of volume e33440b5-6987-41aa-a7fb-ebc603d70da2 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] snapshot_file for this snap is: volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3988c43-01ce-4cc2-93df-3528376e26a5]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:15 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f Jul 03 16:42:15 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:16 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f" returned: 0 in 0.774s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e33440b5-6987-41aa-a7fb-ebc603d70da2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:42:16 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aff43d-f004-49fb-aebc-190266e56d00]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:16 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 Jul 03 16:42:16 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:17 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2" returned: 0 in 0.750s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:17 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f Jul 03 16:42:17 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:17 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f" returned: 0 in 0.787s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:17 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f Jul 03 16:42:17 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:18 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2.b82bd8f0-5bf5-49cf-8a77-db04a217940f" returned: 0 in 0.704s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-b82bd8f0-5bf5-49cf-8a77-db04a217940f" released by "_delete_snapshot" :: held 3.112s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-e33440b5-6987-41aa-a7fb-ebc603d70da2" released by "delete_snapshot" :: held 3.135s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Created reservations ['99d031c4-739c-4a60-b5b9-fba2324c141e', '8c420051-0e9d-45f3-9e02-233bd9ced30b', '7caf0bbf-f835-4122-9495-36cb1566273b', '6ac09924-d1ae-4e07-84b0-182c9bae290e'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:42:18 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Delete snapshot completed successfully. Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-7db006be-dd2b-4adb-b056-592c2944c45f tempest-ProjectMemberTests-1209623427 None] Lock "cinder-b82bd8f0-5bf5-49cf-8a77-db04a217940f-delete_snapshot" released by "delete_snapshot" :: held 3.283s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:19 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:42:19 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-e33440b5-6987-41aa-a7fb-ebc603d70da2-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:19 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.652s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-e33440b5-6987-41aa-a7fb-ebc603d70da2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-e33440b5-6987-41aa-a7fb-ebc603d70da2" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-e33440b5-6987-41aa-a7fb-ebc603d70da2" acquired by "delete_volume" :: waited 0.014s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18c109f-1d65-4515-b07a-c6456d8e4542]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:19 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 Jul 03 16:42:19 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:20 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2" returned: 0 in 0.780s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:20 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2 Jul 03 16:42:20 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:21 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-e33440b5-6987-41aa-a7fb-ebc603d70da2" returned: 0 in 0.687s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-e33440b5-6987-41aa-a7fb-ebc603d70da2" released by "delete_volume" :: held 1.524s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:21 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Created reservations ['55260973-519d-4a97-8120-e0e00112179d', '64e85423-ef45-4fc9-9d1c-158e475e1fa0', '5bf8f9bf-df33-48ba-8691-bce021495817', 'd333c328-18c1-4fb5-aee0-584b6b6e7aff'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:42:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:42:21 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:42:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:21 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:42:21 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:22 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.691s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:42:22 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Deleted volume successfully. Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b53dbea1-c7b5-49aa-b279-d18ffa185695 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-e33440b5-6987-41aa-a7fb-ebc603d70da2-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (cc334ba6-4d58-4a83-aec2-03b061bc2649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989baba0-5ae5-446f-a3ce-06fd0a6d05f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989baba0-5ae5-446f-a3ce-06fd0a6d05f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046210505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:22Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5459e082-c994-4331-a1d7-0492fafb7e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5459e082-c994-4331-a1d7-0492fafb7e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab28331-d09e-464e-90a4-545c0fe7ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab28331-d09e-464e-90a4-545c0fe7ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592', 'volume_name': 'volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7767e9a5-9cf5-453a-a08f-b7e5f3888f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7767e9a5-9cf5-453a-a08f-b7e5f3888f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da39b2df-2dad-4206-afbe-734bc60d3da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:22 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Volume 71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592', 'volume_size': 1} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046210505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:22Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Creating volume 71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:42:22 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:42:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:22 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 1073741824 Jul 03 16:42:22 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:23 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 1073741824" returned: 0 in 0.851s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:23 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 Jul 03 16:42:23 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:23 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" returned: 0 in 0.650s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:42:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da39b2df-2dad-4206-afbe-734bc60d3da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e6cce0-37d8-4715-bdf4-0ce2b2ceb6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:24 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Volume volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 (71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592): created successfully Jul 03 16:42:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e6cce0-37d8-4715-bdf4-0ce2b2ceb6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (cc334ba6-4d58-4a83-aec2-03b061bc2649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:24 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-794ebb45-b10a-4784-89e0-b74848fc1f75 tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:42:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot 2e878c42-161b-4876-86e8-bb1c31dd030a of volume 71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:42:24 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edea30f-50f8-40ae-bc0b-67779739cad4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:24 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 Jul 03 16:42:24 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:25 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" returned: 0 in 0.915s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:25 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a 1G Jul 03 16:42:25 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:26 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a 1G" returned: 0 in 0.857s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:26 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a Jul 03 16:42:26 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:27 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a" returned: 0 in 0.736s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:27 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a is being set with open permissions: ugo+rw Jul 03 16:42:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:27 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a Jul 03 16:42:27 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:27 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a" returned: 0 in 0.712s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:27 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.info Jul 03 16:42:27 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:28 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.info" returned: 0 in 0.720s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:28 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.info is being set with open permissions: ugo+rw Jul 03 16:42:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:28 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.info Jul 03 16:42:28 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:29 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.info" returned: 0 in 0.785s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.819s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:29 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-598563bc-190f-48f1-bcf3-485f05160dba tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-2e878c42-161b-4876-86e8-bb1c31dd030a-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-2e878c42-161b-4876-86e8-bb1c31dd030a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-2e878c42-161b-4876-86e8-bb1c31dd030a" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-2e878c42-161b-4876-86e8-bb1c31dd030a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Deleting offline snapshot 2e878c42-161b-4876-86e8-bb1c31dd030a of volume 71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] snapshot_file for this snap is: volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f89e71b-8419-4908-a618-2ee2238a2d60]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:30 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a Jul 03 16:42:30 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:30 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a" returned: 0 in 0.823s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:42:30 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f48fa-eccb-4be9-b015-f7a202aa7a8c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:30 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 Jul 03 16:42:30 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:31 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" returned: 0 in 0.828s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:31 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a Jul 03 16:42:31 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:32 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a" returned: 0 in 0.786s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:32 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a Jul 03 16:42:32 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:33 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592.2e878c42-161b-4876-86e8-bb1c31dd030a" returned: 0 in 0.762s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-2e878c42-161b-4876-86e8-bb1c31dd030a" released by "_delete_snapshot" :: held 3.298s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" released by "delete_snapshot" :: held 3.327s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:33 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Created reservations ['7d8f32b7-f34e-4111-9017-cae0fa1c399a', '1c8dba60-de93-4b0d-95f3-dcd88db78398', '4d514e3d-8c06-4c94-b692-5659001f5828', '1d62148e-747f-4725-89c8-2592d5d72d40'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:42:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Delete snapshot completed successfully. Jul 03 16:42:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-5f5fea15-f74f-4fab-9218-0378a0df41b4 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-2e878c42-161b-4876-86e8-bb1c31dd030a-delete_snapshot" released by "delete_snapshot" :: held 3.520s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Lock "cinder-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a24c36-caa1-43a2-9ee5-44fccea83f80]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:34 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 Jul 03 16:42:34 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:35 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" returned: 0 in 0.833s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:35 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592 Jul 03 16:42:35 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:35 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" returned: 0 in 0.732s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592" released by "delete_volume" :: held 1.633s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Created reservations ['9c43aff3-885d-43f2-a9d5-9714950487d4', 'c2a19196-190e-422a-bed8-157a6de3cba5', 'fe18f46d-4c79-4d06-a488-6c1eaea9d41b', '1d58646a-9540-4637-bfd1-fd99b9af52e6'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:35 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:42:35 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:36 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.729s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:42:36 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Deleted volume successfully. Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d16c0dc3-cf7c-48d3-b916-cf6809dd8dfa tempest-ProjectMemberTests-1209623427 None] Lock "cinder-71c766a3-7a0a-43a0-b1d8-4b2fdb8c4592-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (5bf7b618-f40a-4f50-9ae1-20efd7f27e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b998996-d037-42f0-adc1-e79654495dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b998996-d037-42f0-adc1-e79654495dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1227639476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:37Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d471f8b-fbf5-4a9a-aa06-912b13211766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d471f8b-fbf5-4a9a-aa06-912b13211766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2282c7-fbf6-4ba1-be58-abe40f0a0a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2282c7-fbf6-4ba1-be58-abe40f0a0a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4', 'volume_name': 'volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36f028e-dccb-450c-b7fd-8e889fe6102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36f028e-dccb-450c-b7fd-8e889fe6102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcae0b4-83e9-479b-97f0-2027db392e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:36 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Volume 9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4', 'volume_size': 1} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1227639476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:37Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Creating volume 9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:36 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:42:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:42:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:37 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:42:37 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:42:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:37 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 1073741824 Jul 03 16:42:37 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:37 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 1073741824" returned: 0 in 0.888s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:37 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 Jul 03 16:42:37 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:38 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" returned: 0 in 0.707s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:38 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:42:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcae0b4-83e9-479b-97f0-2027db392e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dca10b-5315-482b-8fb1-7d50b18804b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:38 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Volume volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 (9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4): created successfully Jul 03 16:42:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dca10b-5315-482b-8fb1-7d50b18804b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:38 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (5bf7b618-f40a-4f50-9ae1-20efd7f27e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:38 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-e0092ad7-4a35-4875-afa7-de3580e6b297 tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:42:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot e8d24b26-c361-4e65-807b-e494dcce9c7c of volume 9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:42:39 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a696e6bf-c97f-4f7b-8541-b2ccfd92cd08]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:39 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 Jul 03 16:42:39 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:39 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" returned: 0 in 0.782s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:39 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c 1G Jul 03 16:42:39 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:40 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c 1G" returned: 0 in 0.917s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:40 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c Jul 03 16:42:40 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:41 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c" returned: 0 in 0.749s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:41 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c is being set with open permissions: ugo+rw Jul 03 16:42:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:41 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c Jul 03 16:42:41 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:42 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c" returned: 0 in 0.670s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:42 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.info Jul 03 16:42:42 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:43 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.info" returned: 0 in 0.762s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:43 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.info is being set with open permissions: ugo+rw Jul 03 16:42:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:43 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.info Jul 03 16:42:43 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:43 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.info" returned: 0 in 0.742s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.713s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:43 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-197f7879-9713-4728-b3cb-9cb28c757573 tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-e8d24b26-c361-4e65-807b-e494dcce9c7c-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-e8d24b26-c361-4e65-807b-e494dcce9c7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-e8d24b26-c361-4e65-807b-e494dcce9c7c" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-e8d24b26-c361-4e65-807b-e494dcce9c7c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Deleting offline snapshot e8d24b26-c361-4e65-807b-e494dcce9c7c of volume 9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] snapshot_file for this snap is: volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecc72a5-854e-4a86-8817-23f0650aaab9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:44 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c Jul 03 16:42:44 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:45 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c" returned: 0 in 0.768s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:45 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:42:45 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9611abb-9bf6-4956-8734-edbd54e5403e]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:45 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 Jul 03 16:42:45 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:46 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" returned: 0 in 0.801s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:46 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c Jul 03 16:42:46 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:46 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c" returned: 0 in 0.785s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:46 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c Jul 03 16:42:46 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:47 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4.e8d24b26-c361-4e65-807b-e494dcce9c7c" returned: 0 in 0.665s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-e8d24b26-c361-4e65-807b-e494dcce9c7c" released by "_delete_snapshot" :: held 3.119s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" released by "delete_snapshot" :: held 3.145s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:47 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Created reservations ['7084ab9d-d199-46d3-9cd6-a4a9294dcb6a', '1d600fbb-9320-4151-bb16-65e3df93073d', '594827dd-ff0d-4b16-90bc-6a8db3443886', '6b9acf5e-92e4-4017-839f-3da41db2e53f'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:42:47 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Delete snapshot completed successfully. Jul 03 16:42:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-293f7184-35e7-4e91-a948-ea4aecc664fd tempest-ProjectMemberTests-1209623427 None] Lock "cinder-e8d24b26-c361-4e65-807b-e494dcce9c7c-delete_snapshot" released by "delete_snapshot" :: held 3.290s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Lock "cinder-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" acquired by "delete_volume" :: waited 0.015s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:48 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d47e31-7366-4a72-a571-6b85abe5746d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:48 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 Jul 03 16:42:48 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:49 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" returned: 0 in 0.804s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:49 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4 Jul 03 16:42:49 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:50 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" returned: 0 in 0.646s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4" released by "delete_volume" :: held 1.509s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:50 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Created reservations ['f4970fd3-144d-47f6-b017-ee7d89f779d8', 'b51f9fa7-8fd5-4493-8e67-7cce0527ff2b', 'ee127f9b-3506-4a72-be11-35833ee2978a', '5f270648-a00c-40f2-891e-e135f4d348cb'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:42:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:42:50 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:42:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:50 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:42:50 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:51 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.669s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:42:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Deleted volume successfully. Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-fe626b52-40f1-4ed2-9410-6f1caa30541d tempest-ProjectMemberTests-1209623427 None] Lock "cinder-9d30b1e9-dd23-4c0b-b5ba-81ee018d71e4-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (03f32d41-fad4-4534-8e3d-37dff2ec9314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c033ec-6bbb-4190-ab89-cef7de08132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c033ec-6bbb-4190-ab89-cef7de08132b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092924886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d6b1d1-eb03-48f6-adf2-689fa9df4548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:51Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75de1257-98cc-4ae2-a332-6d26ec2305c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75de1257-98cc-4ae2-a332-6d26ec2305c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd28949-6b7f-4685-ad37-cad7753ad453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd28949-6b7f-4685-ad37-cad7753ad453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d6b1d1-eb03-48f6-adf2-689fa9df4548', 'volume_name': 'volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9718063-94d2-44ba-b326-04b79a4e3690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9718063-94d2-44ba-b326-04b79a4e3690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043cb815-a1bd-47ad-b52b-3a6ceda8c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Volume c7d6b1d1-eb03-48f6-adf2-689fa9df4548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548', 'volume_size': 1} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092924886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d6b1d1-eb03-48f6-adf2-689fa9df4548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:51Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Creating volume c7d6b1d1-eb03-48f6-adf2-689fa9df4548 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:42:51 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:51 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 1073741824 Jul 03 16:42:51 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (625e9a7e-23a5-456d-badb-ead78a401bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379e7d84-2f6a-4b48-b16e-11161f496b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379e7d84-2f6a-4b48-b16e-11161f496b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1073911190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8f024a-59de-4f4d-8f64-fa206bf8a50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:51Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f06653-1f7a-4451-9541-7ab9490d961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f06653-1f7a-4451-9541-7ab9490d961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57690510-3f60-41fa-aa09-0422a52e1093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57690510-3f60-41fa-aa09-0422a52e1093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8f024a-59de-4f4d-8f64-fa206bf8a50f', 'volume_name': 'volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2df9b19-f1be-4ee2-a697-29a90ca144b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2df9b19-f1be-4ee2-a697-29a90ca144b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e5e71a-1d5c-400d-b966-2caa0b8ed80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Volume 3d8f024a-59de-4f4d-8f64-fa206bf8a50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f', 'volume_size': 1} Jul 03 16:42:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:52 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 1073741824" returned: 0 in 0.887s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:52 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 Jul 03 16:42:52 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:53 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" returned: 0 in 0.678s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1073911190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8f024a-59de-4f4d-8f64-fa206bf8a50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:42:51Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Creating volume 3d8f024a-59de-4f4d-8f64-fa206bf8a50f {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:42:53 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043cb815-a1bd-47ad-b52b-3a6ceda8c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:53 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f 1073741824 Jul 03 16:42:53 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162d577a-9064-4e4f-831d-d3b05461874a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:53 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Volume volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 (c7d6b1d1-eb03-48f6-adf2-689fa9df4548): created successfully Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162d577a-9064-4e4f-831d-d3b05461874a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (03f32d41-fad4-4534-8e3d-37dff2ec9314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:53 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-422edfc3-a0ea-4858-aa55-5489c3125fca tempest-ProjectReaderTests-1936949216 None] Created volume successfully. Jul 03 16:42:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:54 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f 1073741824" returned: 0 in 0.934s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:54 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f Jul 03 16:42:54 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:54 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" returned: 0 in 0.671s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.111s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Creating offline snapshot 9c1e2517-2e8b-4de6-9f21-7812d0827a08 of volume c7d6b1d1-eb03-48f6-adf2-689fa9df4548 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e5e71a-1d5c-400d-b966-2caa0b8ed80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7bf4d0-03ce-4048-8704-60e59f584cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc39f26e-4e01-421d-88ef-18a1dd806579]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:54 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Volume volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f (3d8f024a-59de-4f4d-8f64-fa206bf8a50f): created successfully Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7bf4d0-03ce-4048-8704-60e59f584cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:42:54 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (625e9a7e-23a5-456d-badb-ead78a401bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:42:54 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2785c8dc-9033-42f3-8027-c1bb05e3ed97 tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:42:54 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 Jul 03 16:42:54 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:55 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" returned: 0 in 0.891s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:55 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 1G Jul 03 16:42:55 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:42:56 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 1G" returned: 0 in 0.853s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:56 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 Jul 03 16:42:56 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:57 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08" returned: 0 in 0.728s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:57 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 is being set with open permissions: ugo+rw Jul 03 16:42:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:57 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 Jul 03 16:42:57 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:57 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08" returned: 0 in 0.703s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:58 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.info Jul 03 16:42:58 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:58 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.info" returned: 0 in 0.695s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:58 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.info is being set with open permissions: ugo+rw Jul 03 16:42:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:58 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.info Jul 03 16:42:58 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:59 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.info" returned: 0 in 0.689s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.666s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.488s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot 459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c of volume 3d8f024a-59de-4f4d-8f64-fa206bf8a50f {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:42:59 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-0a2ac3b0-291f-4108-bde2-acfc888d6508 tempest-ProjectReaderTests-1936949216 None] Create snapshot completed successfully Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d387c1-05f8-4d86-bba3-043595fbac3a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:42:59 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f Jul 03 16:42:59 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-9c1e2517-2e8b-4de6-9f21-7812d0827a08-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-9c1e2517-2e8b-4de6-9f21-7812d0827a08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-9c1e2517-2e8b-4de6-9f21-7812d0827a08" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-9c1e2517-2e8b-4de6-9f21-7812d0827a08" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:42:59 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Deleting offline snapshot 9c1e2517-2e8b-4de6-9f21-7812d0827a08 of volume c7d6b1d1-eb03-48f6-adf2-689fa9df4548 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:43:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] snapshot_file for this snap is: volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:43:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[33badeab-a7a5-4d25-8ab2-0d441bb49950]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:00 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 Jul 03 16:43:00 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:00 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" returned: 0 in 0.841s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:00 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c 1G Jul 03 16:43:00 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:00 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08" returned: 0 in 0.868s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:00 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:43:00 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dc047e-34bd-4d90-b7c9-704687976fc2]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:00 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:01 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 Jul 03 16:43:01 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:01 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c 1G" returned: 0 in 0.969s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:01 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c Jul 03 16:43:01 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:01 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" returned: 0 in 0.935s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:01 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:01 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 Jul 03 16:43:01 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:02 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c" returned: 0 in 0.873s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:02 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c is being set with open permissions: ugo+rw Jul 03 16:43:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:02 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c Jul 03 16:43:02 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:02 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08" returned: 0 in 0.873s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:02 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08 Jul 03 16:43:02 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:02 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c" returned: 0 in 0.697s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:02 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.info Jul 03 16:43:02 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:03 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548.9c1e2517-2e8b-4de6-9f21-7812d0827a08" returned: 0 in 0.779s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-9c1e2517-2e8b-4de6-9f21-7812d0827a08" released by "_delete_snapshot" :: held 3.603s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" released by "delete_snapshot" :: held 3.628s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:03 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.info" returned: 0 in 0.761s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:03 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.info is being set with open permissions: ugo+rw Jul 03 16:43:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:03 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.info Jul 03 16:43:03 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:03 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Created reservations ['7f20d6e4-f524-49c1-ba54-70be2bbc4bc0', 'aa6158b6-f56b-4b71-8a78-16ed88bddba0', '1e157b98-2dc6-4f5a-8d4a-b14472d8b30f', 'f8393774-5984-49f4-94d5-a9bc754e0076'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:03 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Delete snapshot completed successfully. Jul 03 16:43:03 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-6ce3874a-29e2-4d02-a665-0065fee0f9e1 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-9c1e2517-2e8b-4de6-9f21-7812d0827a08-delete_snapshot" released by "delete_snapshot" :: held 3.833s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-c7d6b1d1-eb03-48f6-adf2-689fa9df4548-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-c7d6b1d1-eb03-48f6-adf2-689fa9df4548-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:04 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:04 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea801b-f586-4140-bafa-6be191842986]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:04 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.info" returned: 0 in 0.799s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:04 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.045s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:04 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 Jul 03 16:43:04 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-76af2ded-36f3-45df-bce9-51359c164778 tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:43:04 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:05 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" returned: 0 in 0.880s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:05 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548 Jul 03 16:43:05 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Lock "cinder-459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Deleting offline snapshot 459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c of volume 3d8f024a-59de-4f4d-8f64-fa206bf8a50f {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] snapshot_file for this snap is: volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a186ccd-6d16-4172-bb8a-cb694e26579c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:05 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:05 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c Jul 03 16:43:05 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:06 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" returned: 0 in 0.795s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-c7d6b1d1-eb03-48f6-adf2-689fa9df4548" released by "delete_volume" :: held 1.755s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Created reservations ['a0849680-abb4-4ed0-8d0d-63f1b49a8da5', '93e5196a-e2d6-4bbe-8350-d8709fe8cf48', 'e9f81990-8204-4dba-8d83-642d5539c121', 'ea9299de-2280-44d3-8862-b8130d1b5354'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:06 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:43:06 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:06 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c" returned: 0 in 0.963s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[da535bfa-b20d-4525-b3e0-9e65132de20d]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:06 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f Jul 03 16:43:06 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:06 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.738s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:06 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:43:06 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Deleted volume successfully. Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=59,cinder:UPDATE=80,cinder:INSERT=20,cinder:DELETE=7 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-c94fbebe-33fe-40a3-b148-d406d1147906 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-c7d6b1d1-eb03-48f6-adf2-689fa9df4548-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=73,cinder:SELECT=63,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (c25bc6e1-006f-4602-bd3e-b14db96038b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ba2dc-21e7-46a5-8e82-c9e9550c36b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ba2dc-21e7-46a5-8e82-c9e9550c36b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1600969346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153daad2-fff5-43ec-b9c0-39dda5fff107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:07Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cc5e96-3b02-40e2-a3de-149a8ba3076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cc5e96-3b02-40e2-a3de-149a8ba3076d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e083c18-6a25-4a72-9f40-46fa9e3d7539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e083c18-6a25-4a72-9f40-46fa9e3d7539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153daad2-fff5-43ec-b9c0-39dda5fff107', 'volume_name': 'volume-153daad2-fff5-43ec-b9c0-39dda5fff107', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236ea31d-59c7-46af-863a-9ffd66f0fe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236ea31d-59c7-46af-863a-9ffd66f0fe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1829dbb-1a2a-4d11-984c-697810859df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:07 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Volume 153daad2-fff5-43ec-b9c0-39dda5fff107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153daad2-fff5-43ec-b9c0-39dda5fff107', 'volume_size': 1} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1600969346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153daad2-fff5-43ec-b9c0-39dda5fff107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:07Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Creating volume 153daad2-fff5-43ec-b9c0-39dda5fff107 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:43:07 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:07 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 1073741824 Jul 03 16:43:07 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:07 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" returned: 0 in 1.049s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:07 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:07 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c Jul 03 16:43:07 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:08 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 1073741824" returned: 0 in 0.966s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:08 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 Jul 03 16:43:08 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:08 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c" returned: 0 in 0.923s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:08 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:08 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c Jul 03 16:43:08 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:09 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107" returned: 0 in 0.879s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1829dbb-1a2a-4d11-984c-697810859df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153daad2-fff5-43ec-b9c0-39dda5fff107', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1968636-7785-4ade-9434-4bf0c5dde249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:09 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Volume volume-153daad2-fff5-43ec-b9c0-39dda5fff107 (153daad2-fff5-43ec-b9c0-39dda5fff107): created successfully Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1968636-7785-4ade-9434-4bf0c5dde249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (c25bc6e1-006f-4602-bd3e-b14db96038b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:09 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-92fc52e6-2e77-44a0-9134-fbfab716ecb2 tempest-ProjectReaderTests-1936949216 None] Created volume successfully. Jul 03 16:43:09 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f.459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c" returned: 0 in 0.766s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c" released by "_delete_snapshot" :: held 3.833s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" released by "delete_snapshot" :: held 3.858s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Created reservations ['9e9963b9-4319-48e0-8a17-52139f34fcec', '00189d01-ce79-4978-ac1e-d6434de02a98', 'd973059e-da46-4f37-9be9-9d6e387dca2e', '2d54bcd3-44cd-4ee8-9576-bcce162f3a99'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:09 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Delete snapshot completed successfully. Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-9c37e20b-ec7f-42c8-ae5c-fc7eb4e5546c tempest-ProjectMemberTests-1209623427 None] Lock "cinder-459f2e7f-f8f9-4a5b-9dc5-5c8de04d0a2c-delete_snapshot" released by "delete_snapshot" :: held 4.036s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-3d8f024a-59de-4f4d-8f64-fa206bf8a50f-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-3d8f024a-59de-4f4d-8f64-fa206bf8a50f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" acquired by "delete_volume" :: waited 0.024s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaea4d0e-0b1f-4a40-b16c-efb8d9a1d4a9]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:09 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:09 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f Jul 03 16:43:09 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:10 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Creating offline snapshot 45054ce3-72be-4adb-9284-4da0bf161987 of volume 153daad2-fff5-43ec-b9c0-39dda5fff107 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:43:10 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[453f8d45-b6d8-4004-983d-12d2d5124843]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:10 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 Jul 03 16:43:10 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:10 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" returned: 0 in 1.063s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:10 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:10 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f Jul 03 16:43:10 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:11 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107" returned: 0 in 0.941s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:11 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 1G Jul 03 16:43:11 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:11 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" returned: 0 in 0.786s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-3d8f024a-59de-4f4d-8f64-fa206bf8a50f" released by "delete_volume" :: held 1.921s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Created reservations ['492f932b-b928-494d-a626-883d2304d356', '9797938a-cbea-40ca-90f7-4d48c22932c2', 'a5cb7ac1-f174-4743-865b-453668319ad4', 'add5e4b5-35eb-4162-aaa9-cf2200a62d1a'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:11 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:43:11 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:43:12 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (96f508cf-0854-4db0-88f1-9d3fe58a4a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd95983-e570-4622-a16a-6b9fd668e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 1G" returned: 0 in 1.139s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-153daad2-fff5-43ec-b9c0-39dda5fff107 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd95983-e570-4622-a16a-6b9fd668e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745075441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1b07b8-1b3c-448c-a95e-ae8ba802d43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:13Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:12 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-153daad2-fff5-43ec-b9c0-39dda5fff107 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 Jul 03 16:43:12 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889c0bac-e0c2-4eee-a42b-72491ec37453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889c0bac-e0c2-4eee-a42b-72491ec37453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef49166-9e32-497e-ae0f-f22893fb05f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef49166-9e32-497e-ae0f-f22893fb05f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1b07b8-1b3c-448c-a95e-ae8ba802d43c', 'volume_name': 'volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd80695-676d-447b-af65-98bacccc11e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd80695-676d-447b-af65-98bacccc11e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32612212-c036-4e73-9d5b-86427f867554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:12 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Volume 1b1b07b8-1b3c-448c-a95e-ae8ba802d43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c', 'volume_size': 1} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:12 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.864s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:43:12 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Deleted volume successfully. Jul 03 16:43:12 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b6bd8d0c-687a-4f0c-af32-20d56a5d7314 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-3d8f024a-59de-4f4d-8f64-fa206bf8a50f-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:13 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-153daad2-fff5-43ec-b9c0-39dda5fff107 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987" returned: 0 in 0.825s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:13 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 is being set with open permissions: ugo+rw Jul 03 16:43:13 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:13 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 Jul 03 16:43:13 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:14 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987" returned: 0 in 0.711s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:14 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.info Jul 03 16:43:14 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:14 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.info" returned: 0 in 0.709s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:14 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.info is being set with open permissions: ugo+rw Jul 03 16:43:14 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:15 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.info Jul 03 16:43:15 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:15 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.info" returned: 0 in 0.742s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.171s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.972s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745075441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1b07b8-1b3c-448c-a95e-ae8ba802d43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974e7e05b24f41bab69c5c57af4ecef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:13Z,use_quota=True,user_id='d2de6c200e7f4f7d9014ae31e29be522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Creating volume 1b1b07b8-1b3c-448c-a95e-ae8ba802d43c {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:43:15 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:43:15 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:15 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c 1073741824 Jul 03 16:43:15 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:15 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-494039c8-e35f-4456-a4bb-ad71bf54c447 tempest-ProjectReaderTests-1936949216 None] Create snapshot completed successfully Jul 03 16:43:16 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c 1073741824" returned: 0 in 0.926s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:16 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c Jul 03 16:43:16 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-45054ce3-72be-4adb-9284-4da0bf161987-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-45054ce3-72be-4adb-9284-4da0bf161987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-153daad2-fff5-43ec-b9c0-39dda5fff107" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-153daad2-fff5-43ec-b9c0-39dda5fff107" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-45054ce3-72be-4adb-9284-4da0bf161987" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-45054ce3-72be-4adb-9284-4da0bf161987" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Deleting offline snapshot 45054ce3-72be-4adb-9284-4da0bf161987 of volume 153daad2-fff5-43ec-b9c0-39dda5fff107 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] snapshot_file for this snap is: volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[812049c0-5936-4a47-93b8-054853f34c41]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:16 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:17 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 Jul 03 16:43:17 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:17 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" returned: 0 in 0.839s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32612212-c036-4e73-9d5b-86427f867554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cd5f19-b50c-45c6-9029-4fa64648e84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:17 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Volume volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c (1b1b07b8-1b3c-448c-a95e-ae8ba802d43c): created successfully Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cd5f19-b50c-45c6-9029-4fa64648e84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Flow 'volume_create_manager' (96f508cf-0854-4db0-88f1-9d3fe58a4a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:17 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ef5ad506-e7fa-46d2-baf7-20fabdf8a654 tempest-ProjectMemberTests-1209623427 None] Created volume successfully. Jul 03 16:43:17 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987" returned: 0 in 0.915s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-153daad2-fff5-43ec-b9c0-39dda5fff107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd5212a-9588-4b91-b44c-d23a59903518]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:17 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:18 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 Jul 03 16:43:18 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Creating offline snapshot 82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 of volume 1b1b07b8-1b3c-448c-a95e-ae8ba802d43c {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af44e3-0a46-43ed-8944-f91504f77892]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:18 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c Jul 03 16:43:18 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:18 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107" returned: 0 in 1.006s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:19 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 Jul 03 16:43:19 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:19 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:43:19 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:19 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" returned: 0 in 0.981s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:19 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 1G Jul 03 16:43:19 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:19 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.794s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:43:19 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987" returned: 0 in 0.982s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:19 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987 Jul 03 16:43:19 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:20 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 1G" returned: 0 in 1.085s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:20 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 Jul 03 16:43:20 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:20 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:20 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107.45054ce3-72be-4adb-9284-4da0bf161987" returned: 0 in 0.794s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-45054ce3-72be-4adb-9284-4da0bf161987" released by "_delete_snapshot" :: held 3.845s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-153daad2-fff5-43ec-b9c0-39dda5fff107" released by "delete_snapshot" :: held 3.874s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:20 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Created reservations ['dac1537b-ba37-4f9a-8e78-3762b5fdbdba', 'abc28e61-8973-473d-8785-1dace6d597e6', '1a529fb0-f2b7-409d-a4c7-7fd43f51d9e1', '190bb766-a771-427b-b7dc-481ddd3d221b'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:20 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Delete snapshot completed successfully. Jul 03 16:43:20 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2b4a6cac-cc40-4fad-a332-4b1dd59991a6 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-45054ce3-72be-4adb-9284-4da0bf161987-delete_snapshot" released by "delete_snapshot" :: held 4.041s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:21 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32" returned: 0 in 0.790s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:21 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 is being set with open permissions: ugo+rw Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:21 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 Jul 03 16:43:21 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-153daad2-fff5-43ec-b9c0-39dda5fff107-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-153daad2-fff5-43ec-b9c0-39dda5fff107-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-153daad2-fff5-43ec-b9c0-39dda5fff107" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-153daad2-fff5-43ec-b9c0-39dda5fff107" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[657b42a4-fbe3-4250-aa24-40a870cc4e4b]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:21 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 Jul 03 16:43:21 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:21 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32" returned: 0 in 0.773s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:21 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:21 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.info Jul 03 16:43:21 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:22 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107" returned: 0 in 0.885s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:22 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107 Jul 03 16:43:22 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:22 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.info" returned: 0 in 0.771s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:22 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.info is being set with open permissions: ugo+rw Jul 03 16:43:22 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:22 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.info Jul 03 16:43:22 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:23 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-153daad2-fff5-43ec-b9c0-39dda5fff107" returned: 0 in 0.817s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-153daad2-fff5-43ec-b9c0-39dda5fff107" released by "delete_volume" :: held 1.791s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Created reservations ['cd109d57-2f16-49fd-acbb-a72aa1d4a601', '57ec0b62-3eec-4b4f-991e-eb2c95ea3fca', '371def3f-e6be-4d78-a356-36d45c02aab7', 'da0a960a-2ab6-469c-b545-b7cf48997d75'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:23 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:43:23 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:23 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.info" returned: 0 in 0.833s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.361s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:23 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d92b94bb-1fea-43d7-9d1b-b7ed42ebe037 tempest-ProjectMemberTests-1209623427 None] Create snapshot completed successfully Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:43:23 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (734e01ca-f722-44d7-93e4-9f477ab5d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b9dfa5-a90f-4747-9421-5338ff53530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b9dfa5-a90f-4747-9421-5338ff53530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614929346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:24Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b822e7-df24-4cc0-8b24-cd2ee7db7561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b822e7-df24-4cc0-8b24-cd2ee7db7561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a8a871-c7c6-4859-9274-8df08a205939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a8a871-c7c6-4859-9274-8df08a205939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991', 'volume_name': 'volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0985160a-e46a-4a30-b6c8-4bb2bc06fd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0985160a-e46a-4a30-b6c8-4bb2bc06fd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb83739a-2ed5-48c2-9cb5-b7d1b2430929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:24 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Volume 3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991', 'volume_size': 1} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614929346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e5d79f594341aab986564a94373e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:24Z,use_quota=True,user_id='2cbc04accf684a9099feafa57e391987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Creating volume 3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:43:24 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:24 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 1073741824 Jul 03 16:43:24 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:24 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.941s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:43:24 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Deleted volume successfully. Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-aef98223-1132-4842-bcad-cb941a277d15 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-153daad2-fff5-43ec-b9c0-39dda5fff107-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Deleting offline snapshot 82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 of volume 1b1b07b8-1b3c-448c-a95e-ae8ba802d43c {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] snapshot_file for this snap is: volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[029ed9a4-8055-4f0c-b62f-eea1a07af253]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:24 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:24 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 Jul 03 16:43:24 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:25 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 1073741824" returned: 0 in 1.075s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:25 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 Jul 03 16:43:25 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:25 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32" returned: 0 in 0.957s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:25 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:43:25 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c174abe-e916-404e-b002-b2f0c8e7a6cd]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:25 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:25 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c Jul 03 16:43:25 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:26 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" returned: 0 in 0.857s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:43:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb83739a-2ed5-48c2-9cb5-b7d1b2430929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d422fc17-ab58-478f-99bd-6aea2e044449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Volume volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 (3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991): created successfully Jul 03 16:43:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d422fc17-ab58-478f-99bd-6aea2e044449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Flow 'volume_create_manager' (734e01ca-f722-44d7-93e4-9f477ab5d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:26 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d7cb3db8-b836-4f5e-9751-5105a55a7f58 tempest-ProjectReaderTests-1936949216 None] Created volume successfully. Jul 03 16:43:26 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" returned: 0 in 0.802s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:26 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 Jul 03 16:43:26 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Creating offline snapshot 7829c020-baae-4b05-aa53-878e35584051 of volume 3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:43:27 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a019ef0-15e4-41c1-bb60-ce272d4e74a4]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:27 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32" returned: 0 in 0.950s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:27 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 Jul 03 16:43:27 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:27 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32 Jul 03 16:43:27 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:28 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" returned: 0 in 0.851s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:28 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 1G Jul 03 16:43:28 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:28 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c.82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32" returned: 0 in 0.828s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32" released by "_delete_snapshot" :: held 3.674s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" released by "delete_snapshot" :: held 3.706s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:28 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Created reservations ['94944b1d-a3a6-409c-8140-50fce3d3c8c3', '3985a053-2724-4e46-8753-10750f1d66ed', '61635ba1-b6a1-49c7-81f2-cab57ac9e603', '46c7d710-1506-48d9-802b-aca83f948499'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Delete snapshot completed successfully. Jul 03 16:43:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-ec5ba331-7d78-4b37-860e-a560b32e9738 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-82c6c2f9-596b-4f4c-ad0b-1e6c5d841f32-delete_snapshot" released by "delete_snapshot" :: held 3.918s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:28 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "cinder-quobyte-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:29 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" acquired by "delete_volume" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:29 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb023783-9835-4932-a010-8fa2ee864f69]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:29 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c Jul 03 16:43:29 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:29 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 1G" returned: 0 in 0.986s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:29 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 Jul 03 16:43:29 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:29 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" returned: 0 in 0.842s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:29 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c Jul 03 16:43:29 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:30 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051" returned: 0 in 0.839s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:30 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 is being set with open permissions: ugo+rw Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:30 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 Jul 03 16:43:30 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:30 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" returned: 0 in 0.762s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-quobyte-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c" released by "delete_volume" :: held 1.682s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Created reservations ['c599f273-f12f-4442-a20d-beff15004af4', '9d3172ef-5039-49c0-a436-bec9ac240d74', '79cf37ab-df18-4a06-9402-54d48fa73131', '981f54e5-052b-491f-8cce-c5e186c631a6'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:30 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051" returned: 0 in 0.732s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:30 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.info Jul 03 16:43:30 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:30 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:43:30 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:31 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.info" returned: 0 in 0.799s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:31 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.info is being set with open permissions: ugo+rw Jul 03 16:43:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:31 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.info Jul 03 16:43:31 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:31 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.822s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:31 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:43:31 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Deleted volume successfully. Jul 03 16:43:31 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-45734b74-688b-4e57-8d54-46541d782849 tempest-ProjectMemberTests-1209623427 None] Lock "cinder-1b1b07b8-1b3c-448c-a95e-ae8ba802d43c-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:32 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.info" returned: 0 in 0.888s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.230s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:32 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-fc236ccf-88ae-4ece-9179-c46ca9505b68 tempest-ProjectReaderTests-1936949216 None] Create snapshot completed successfully Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-7829c020-baae-4b05-aa53-878e35584051-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Lock "cinder-7829c020-baae-4b05-aa53-878e35584051-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-7829c020-baae-4b05-aa53-878e35584051" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-7829c020-baae-4b05-aa53-878e35584051" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Deleting offline snapshot 7829c020-baae-4b05-aa53-878e35584051 of volume 3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] snapshot_file for this snap is: volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[448b1bf0-0350-41fe-860b-5f3c7a4e328a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:33 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 Jul 03 16:43:33 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:34 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051" returned: 0 in 0.831s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:43:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd15347-6dad-456b-b73c-92702281aa2a]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:34 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 Jul 03 16:43:34 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:35 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" returned: 0 in 0.869s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:35 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 Jul 03 16:43:35 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:36 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051" returned: 0 in 0.818s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:36 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051 Jul 03 16:43:36 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:37 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:37 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991.7829c020-baae-4b05-aa53-878e35584051" returned: 0 in 0.722s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-7829c020-baae-4b05-aa53-878e35584051" released by "_delete_snapshot" :: held 3.363s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" released by "delete_snapshot" :: held 3.392s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:37 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Created reservations ['a8a7fb8d-5944-40e6-b9ca-9d9c667a028f', '52cb9b52-6c6c-4346-9f70-2df44c7deafc', '924120e9-2ff0-441c-bc95-9dee1b6cc7b4', '6f1f55aa-bcee-4f95-9ed2-3cbabafc7456'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:37 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Delete snapshot completed successfully. Jul 03 16:43:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-f7ae530f-0141-45b1-9671-f86e662272ab tempest-ProjectReaderTests-1936949216 None] Lock "cinder-7829c020-baae-4b05-aa53-878e35584051-delete_snapshot" released by "delete_snapshot" :: held 3.578s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:37 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "cinder-quobyte-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:38 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" acquired by "delete_volume" :: waited 0.014s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:38 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbfa221-6a0a-4084-a872-c4cdebb201e7]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:38 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 Jul 03 16:43:38 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:38 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" returned: 0 in 0.901s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:38 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:39 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991 Jul 03 16:43:39 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:39 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" returned: 0 in 0.720s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:39 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-quobyte-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991" released by "delete_volume" :: held 1.683s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:39 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Created reservations ['84758938-4501-4fd8-ae89-35ef3a598474', '99efe8cd-6eb9-4180-a837-5ed062ee100a', 'dba30745-9e4d-4a51-852f-9e2575e1210d', 'ceb1ecdd-051b-49a3-9b06-bc4b59ceee72'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:39 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:39 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:39 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:43:39 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:40 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:40 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.786s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:40 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:43:40 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Deleted volume successfully. Jul 03 16:43:40 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b109cebc-424f-4590-9c6a-2d4e7ea71326 tempest-ProjectReaderTests-1936949216 None] Lock "cinder-3bbbb0cd-a440-42a1-ba9d-f4d5f8c37991-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Flow 'volume_create_manager' (d33d11f3-df03-47f6-b11c-44302f3b8274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62eb1b94-d721-4763-a2eb-d145ff545f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62eb1b94-d721-4763-a2eb-d145ff545f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375732907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd26c27-ab61-4eed-9b75-f915a8f07ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4151786824c445e81a532173778a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:45Z,use_quota=True,user_id='8c0f83d749d341f9878f36be4c65ff39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8bf730-248c-4f69-89bf-efc2dcc0d701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8bf730-248c-4f69-89bf-efc2dcc0d701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f91b90-ad31-4fd3-9f57-41a51fce9b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f91b90-ad31-4fd3-9f57-41a51fce9b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd26c27-ab61-4eed-9b75-f915a8f07ef8', 'volume_name': 'volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7153f1f1-ec71-4727-9a4e-f0e6b28aeab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7153f1f1-ec71-4727-9a4e-f0e6b28aeab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79daf0f3-7b82-4905-a4d1-dd8188c04b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:44 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Volume 5fd26c27-ab61-4eed-9b75-f915a8f07ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8', 'volume_size': 1} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375732907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd26c27-ab61-4eed-9b75-f915a8f07ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4151786824c445e81a532173778a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:45Z,use_quota=True,user_id='8c0f83d749d341f9878f36be4c65ff39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Creating volume 5fd26c27-ab61-4eed-9b75-f915a8f07ef8 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:43:44 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:43:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:44 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 1073741824 Jul 03 16:43:44 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:45 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 1073741824" returned: 0 in 0.863s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:45 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 Jul 03 16:43:45 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:46 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8" returned: 0 in 0.654s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:46 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:43:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79daf0f3-7b82-4905-a4d1-dd8188c04b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083b5962-9b42-492d-933b-6ccc9df3f3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:46 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Volume volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 (5fd26c27-ab61-4eed-9b75-f915a8f07ef8): created successfully Jul 03 16:43:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083b5962-9b42-492d-933b-6ccc9df3f3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:46 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Flow 'volume_create_manager' (d33d11f3-df03-47f6-b11c-44302f3b8274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:46 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-979f5afa-59ea-45a1-ba6a-92e60289e4ab tempest-ProjectReaderTests-1586611494 None] Created volume successfully. Jul 03 16:43:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Acquiring lock "cinder-5fd26c27-ab61-4eed-9b75-f915a8f07ef8-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Lock "cinder-5fd26c27-ab61-4eed-9b75-f915a8f07ef8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Acquiring lock "cinder-quobyte-5fd26c27-ab61-4eed-9b75-f915a8f07ef8" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Lock "cinder-quobyte-5fd26c27-ab61-4eed-9b75-f915a8f07ef8" acquired by "delete_volume" :: waited 0.013s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:47 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6e2aec-c053-4984-8285-c179e13061fc]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:47 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 Jul 03 16:43:47 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:47 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8" returned: 0 in 0.799s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:47 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8 Jul 03 16:43:47 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:48 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-5fd26c27-ab61-4eed-9b75-f915a8f07ef8" returned: 0 in 0.660s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:48 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Lock "cinder-quobyte-5fd26c27-ab61-4eed-9b75-f915a8f07ef8" released by "delete_volume" :: held 1.500s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:48 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Created reservations ['34cab643-682b-4bff-9895-02962609d74c', '09f7b9a1-44e1-4e60-a4ee-ac18a837103f', '21b148dc-9c18-4ed2-8e4e-2f5b3a0c24dc', '8ff2bb68-dc4a-46dc-9ddd-0ffb02a5f3c7'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:48 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:48 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:43:48 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:49 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.727s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:43:49 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Deleted volume successfully. Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-2282cfbd-0c02-468f-8b0d-93ef4b06d45f tempest-ProjectReaderTests-1586611494 None] Lock "cinder-5fd26c27-ab61-4eed-9b75-f915a8f07ef8-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Flow 'volume_create_manager' (a760ef84-a5a0-4b1f-bc97-0d33d879e313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868d499e-3ebd-4e17-a602-4fdf30223acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868d499e-3ebd-4e17-a602-4fdf30223acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691529352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d10714-ad3f-4076-808c-5fdf0d2be677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4151786824c445e81a532173778a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:50Z,use_quota=True,user_id='8c0f83d749d341f9878f36be4c65ff39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00375de6-40dd-4334-a713-7479d6f81f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00375de6-40dd-4334-a713-7479d6f81f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e19cdc-f6b8-41e5-9c45-244aad003113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e19cdc-f6b8-41e5-9c45-244aad003113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d10714-ad3f-4076-808c-5fdf0d2be677', 'volume_name': 'volume-80d10714-ad3f-4076-808c-5fdf0d2be677', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10434019-6a5e-4646-b4ab-2393943275ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10434019-6a5e-4646-b4ab-2393943275ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c35316-e24d-4d66-815d-3afe7adee129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:49 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Volume 80d10714-ad3f-4076-808c-5fdf0d2be677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d10714-ad3f-4076-808c-5fdf0d2be677', 'volume_size': 1} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691529352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d10714-ad3f-4076-808c-5fdf0d2be677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4151786824c445e81a532173778a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:43:50Z,use_quota=True,user_id='8c0f83d749d341f9878f36be4c65ff39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Creating volume 80d10714-ad3f-4076-808c-5fdf0d2be677 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:43:49 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:43:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:49 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677 1073741824 Jul 03 16:43:49 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:50 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677 1073741824" returned: 0 in 0.862s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:50 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677 Jul 03 16:43:50 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:51 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677" returned: 0 in 0.666s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c35316-e24d-4d66-815d-3afe7adee129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d10714-ad3f-4076-808c-5fdf0d2be677', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30be2bc-e982-4870-a5d4-fe2395523c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:43:51 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Volume volume-80d10714-ad3f-4076-808c-5fdf0d2be677 (80d10714-ad3f-4076-808c-5fdf0d2be677): created successfully Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30be2bc-e982-4870-a5d4-fe2395523c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Flow 'volume_create_manager' (a760ef84-a5a0-4b1f-bc97-0d33d879e313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:43:51 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-287bea78-fb17-481b-885f-cb5e851deccf tempest-ProjectReaderTests-1586611494 None] Created volume successfully. Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Acquiring lock "cinder-80d10714-ad3f-4076-808c-5fdf0d2be677-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Lock "cinder-80d10714-ad3f-4076-808c-5fdf0d2be677-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Acquiring lock "cinder-quobyte-80d10714-ad3f-4076-808c-5fdf0d2be677" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Lock "cinder-quobyte-80d10714-ad3f-4076-808c-5fdf0d2be677" acquired by "delete_volume" :: waited 0.015s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe7beb-db7a-45df-92b7-c169de50eb92]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:43:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:52 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677 Jul 03 16:43:52 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:52 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677" returned: 0 in 0.927s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:52 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677 Jul 03 16:43:52 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:53 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-80d10714-ad3f-4076-808c-5fdf0d2be677" returned: 0 in 0.704s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:53 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Lock "cinder-quobyte-80d10714-ad3f-4076-808c-5fdf0d2be677" released by "delete_volume" :: held 1.673s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:43:53 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Created reservations ['71aeca2a-b9cf-48e4-92a6-13121486d4ee', '56a36dbe-82a3-4c0f-b48b-95058ae7165b', 'f8780467-6852-437e-8b42-d725b1fb9d25', 'b79deb0e-9300-4dab-94d7-67f19bfb58b1'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:43:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:43:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:43:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:43:53 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:43:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:43:53 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:43:53 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:43:53 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:43:54 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Jul 03 16:43:54 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.690s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:43:54 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:43:54 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Deleted volume successfully. Jul 03 16:43:54 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-82ddacea-368d-4c8c-b4b8-77d2709caf92 tempest-ProjectReaderTests-1586611494 None] Lock "cinder-80d10714-ad3f-4076-808c-5fdf0d2be677-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:44:03 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=100,cinder:SELECT=60,cinder:INSERT=27,cinder:DELETE=4 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:44:04 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=71,cinder:INSERT=21,cinder:UPDATE=80,cinder:DELETE=10 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:44:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:44:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:44:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:44:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:44:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:44:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:44:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:19 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:44:19 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:19 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.893s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:44:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:44:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:44:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Flow 'volume_create_manager' (b8a0d0a8-ba4a-4366-a2da-554faabafcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fb4549-fbcd-4f66-8917-d7864f60d524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fb4549-fbcd-4f66-8917-d7864f60d524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-927112018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a40e0a2-578b-40b7-8fa4-9cb90e4386e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df4aba4afef458e883a9012a3d2ec04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:44:26Z,use_quota=True,user_id='2aefde1748684f93a80baa1a371fcd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8a3a1a-e7dc-4c6b-a9c9-76912bfb7599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8a3a1a-e7dc-4c6b-a9c9-76912bfb7599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492e780b-2774-4aa5-881b-c06c878ce14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492e780b-2774-4aa5-881b-c06c878ce14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a40e0a2-578b-40b7-8fa4-9cb90e4386e7', 'volume_name': 'volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7f8194-bf3e-489e-be1c-2de752baf470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7f8194-bf3e-489e-be1c-2de752baf470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16abeb79-0bb2-4490-b828-6d7cf0661ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:26 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Volume 0a40e0a2-578b-40b7-8fa4-9cb90e4386e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7', 'volume_size': 1} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-927112018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a40e0a2-578b-40b7-8fa4-9cb90e4386e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df4aba4afef458e883a9012a3d2ec04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:44:26Z,use_quota=True,user_id='2aefde1748684f93a80baa1a371fcd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)}" {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Creating volume 0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:44:26 devstack cinder-volume[86659]: INFO cinder.volume.drivers.remotefs [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] casted to osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 Jul 03 16:44:26 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 1073741824 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:26 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 1073741824 Jul 03 16:44:26 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:27 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 1073741824" returned: 0 in 0.822s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:27 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 Jul 03 16:44:27 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:27 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" returned: 0 in 0.635s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:27 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'} {{(pid=86659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 16:44:27 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:44:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16abeb79-0bb2-4490-b828-6d7cf0661ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7', 'volume_size': 1}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9367ed4-d360-49dd-99d1-6f4b6272e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:27 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Volume volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 (0a40e0a2-578b-40b7-8fa4-9cb90e4386e7): created successfully Jul 03 16:44:27 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9367ed4-d360-49dd-99d1-6f4b6272e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:28 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Flow 'volume_create_manager' (b8a0d0a8-ba4a-4366-a2da-554faabafcb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:44:28 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-9154fd66-1e2e-49c9-8483-c23a9c40a4c2 tempest-SnapshotDependencyTests-123431467 None] Created volume successfully. Jul 03 16:44:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:44:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:44:28 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Creating offline snapshot bf9acc39-4eac-4853-a464-98b3542f5eb1 of volume 0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 16:44:28 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f4eaee-67bb-4a69-8d5f-1094db31131c]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:44:28 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:28 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 Jul 03 16:44:28 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:29 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" returned: 0 in 0.818s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:29 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 1G {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:29 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 1G Jul 03 16:44:29 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:30 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 1G" returned: 0 in 0.797s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:30 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:30 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 Jul 03 16:44:30 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:31 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 -F qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1" returned: 0 in 0.677s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:31 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 is being set with open permissions: ugo+rw Jul 03 16:44:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:31 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 Jul 03 16:44:31 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:31 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1" returned: 0 in 0.729s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:31 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:31 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.info Jul 03 16:44:31 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:32 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.info" returned: 0 in 0.728s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:32 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.info is being set with open permissions: ugo+rw Jul 03 16:44:32 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.info {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:32 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.info Jul 03 16:44:32 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:33 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.info" returned: 0 in 0.690s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:33 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.528s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:44:33 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-c497964e-e6cf-416e-b4c1-c2661f3c8166 tempest-SnapshotDependencyTests-123431467 None] Create snapshot completed successfully Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Flow 'volume_create_manager' (7e37e8b9-2f65-4569-a3cc-b8472253b95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e08f1e3-933f-421c-b027-3fd2cebbbfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e08f1e3-933f-421c-b027-3fd2cebbbfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T14:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e99395-f2ef-4989-b2f4-dee58e61f14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df4aba4afef458e883a9012a3d2ec04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T14:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf9acc39-4eac-4853-a464-98b3542f5eb1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T14:44:34Z,use_quota=True,user_id='2aefde1748684f93a80baa1a371fcd63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcdc15b6-5457-49b6-8e23-72ef43adb36f),volume_type_id=fcdc15b6-5457-49b6-8e23-72ef43adb36f)' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6037a7ea-0ffa-4bbd-a5ee-21a83af1ab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6037a7ea-0ffa-4bbd-a5ee-21a83af1ab0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeeb2a10-3d8e-4f8b-9b3b-ca43b233f4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeeb2a10-3d8e-4f8b-9b3b-ca43b233f4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5e99395-f2ef-4989-b2f4-dee58e61f14b', 'volume_name': 'volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b', 'volume_size': 1, 'snapshot_id': 'bf9acc39-4eac-4853-a464-98b3542f5eb1'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38450021-5af7-40cd-800f-c31f9ee418f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38450021-5af7-40cd-800f-c31f9ee418f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba21d84c-b134-4436-b917-a2a3a74d5b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:34 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Volume d5e99395-f2ef-4989-b2f4-dee58e61f14b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b', 'volume_size': 1, 'snapshot_id': 'bf9acc39-4eac-4853-a464-98b3542f5eb1'} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "cinder-quobyte-bf9acc39-4eac-4853-a464-98b3542f5eb1-d5e99395-f2ef-4989-b2f4-dee58e61f14b" by "_create_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-bf9acc39-4eac-4853-a464-98b3542f5eb1-d5e99395-f2ef-4989-b2f4-dee58e61f14b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Creating volume d5e99395-f2ef-4989-b2f4-dee58e61f14b from snapshot bf9acc39-4eac-4853-a464-98b3542f5eb1 {{(pid=86659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Selected osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816 as target Quobyte volume. {{(pid=86659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "cinder-quobyte-d5e99395-f2ef-4989-b2f4-dee58e61f14b" by "_copy_volume_from_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-d5e99395-f2ef-4989-b2f4-dee58e61f14b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] snapshot: bf9acc39-4eac-4853-a464-98b3542f5eb1, volume: d5e99395-f2ef-4989-b2f4-dee58e61f14b, {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6969ebc8-ae3c-4edc-9e95-b4481cf7bccd]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:44:34 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:34 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 Jul 03 16:44:34 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:35 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1" returned: 0 in 0.896s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:44:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 16:44:35 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Creating direct copy from snapshot {{(pid=86659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 16:44:35 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[434e5720-e53c-4759-8593-8d5e9863e372]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:44:35 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:35 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 Jul 03 16:44:35 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:36 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" returned: 0 in 0.962s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:36 devstack cinder-volume[86659]: DEBUG cinder.utils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Path /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b not found in is_blk_device check {{(pid=86659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 16:44:36 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:36 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b Jul 03 16:44:36 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:41 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b" returned: 0 in 4.735s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:41 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b2c27-a105-4602-8585-d3a6fbcb5929]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:44:41 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:41 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 Jul 03 16:44:41 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:42 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" returned: 0 in 0.934s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:42 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Image conversion details: src /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b {{(pid=86659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 16:44:42 devstack cinder-volume[86659]: INFO cinder.image.image_utils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Converted 1024.00 MB image at 216.20 MB/s Jul 03 16:44:42 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.remotefs [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b is being set with open permissions: ugo+rw Jul 03 16:44:42 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:42 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b Jul 03 16:44:42 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:43 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b" returned: 0 in 0.799s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-d5e99395-f2ef-4989-b2f4-dee58e61f14b" released by "_copy_volume_from_snapshot" :: held 8.429s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-bf9acc39-4eac-4853-a464-98b3542f5eb1-d5e99395-f2ef-4989-b2f4-dee58e61f14b" released by "_create_volume_from_snapshot" :: held 8.463s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.477s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba21d84c-b134-4436-b917-a2a3a74d5b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b', 'volume_size': 1, 'snapshot_id': 'bf9acc39-4eac-4853-a464-98b3542f5eb1'}' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7397376-5dc6-44dc-8876-8eac214e6b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 16:44:43 devstack cinder-volume[86659]: INFO cinder.volume.flows.manager.create_volume [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Volume volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b (d5e99395-f2ef-4989-b2f4-dee58e61f14b): created successfully Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7397376-5dc6-44dc-8876-8eac214e6b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Flow 'volume_create_manager' (7e37e8b9-2f65-4569-a3cc-b8472253b95f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 16:44:43 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d5616ad5-fd2b-4887-bc9b-b6b644c7c69b tempest-SnapshotDependencyTests-123431467 None] Created volume successfully. Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "cinder-bf9acc39-4eac-4853-a464-98b3542f5eb1-delete_snapshot" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-bf9acc39-4eac-4853-a464-98b3542f5eb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "cinder-quobyte-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" by "delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "cinder-quobyte-bf9acc39-4eac-4853-a464-98b3542f5eb1" by "_delete_snapshot" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-bf9acc39-4eac-4853-a464-98b3542f5eb1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Deleting offline snapshot bf9acc39-4eac-4853-a464-98b3542f5eb1 of volume 0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] snapshot_file for this snap is: volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 {{(pid=86659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfbebad-ea71-4c56-ba9b-76a7d92bdd17]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:44:43 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:43 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 Jul 03 16:44:43 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:44 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1" returned: 0 in 0.839s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:44 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 16:44:44 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b4ab1c-69e0-413e-adc4-9aa6a364eeb5]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:44:44 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:44 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 Jul 03 16:44:44 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:45 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" returned: 0 in 0.812s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:45 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:45 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 Jul 03 16:44:45 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:46 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1" returned: 0 in 0.860s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:46 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1 Jul 03 16:44:46 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:46 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:46 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7.bf9acc39-4eac-4853-a464-98b3542f5eb1" returned: 0 in 0.702s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-bf9acc39-4eac-4853-a464-98b3542f5eb1" released by "_delete_snapshot" :: held 3.383s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:44:46 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" released by "delete_snapshot" :: held 3.409s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:44:47 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Created reservations ['5f8b43f3-b202-4b32-b0f1-15fa90975ce2', '22ddc95f-88a4-4cdf-a3f6-ed7916cbd869', '31ab1d34-bf7b-4535-9c38-6ba74b2b4bea', 'b8a9a079-5328-4363-93e2-17fa49c89ddc'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:44:47 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Delete snapshot completed successfully. Jul 03 16:44:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-48f48c81-2569-42eb-b456-75dd0c7c0111 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-bf9acc39-4eac-4853-a464-98b3542f5eb1-delete_snapshot" released by "delete_snapshot" :: held 3.567s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:44:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "cinder-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:44:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:44:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "cinder-quobyte-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:44:47 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" acquired by "delete_volume" :: waited 0.019s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:44:47 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26a9472-1ab6-421b-8bf9-97ba9969d681]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:44:47 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:48 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 Jul 03 16:44:48 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:48 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" returned: 0 in 0.918s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:48 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:48 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7 Jul 03 16:44:48 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:49 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" returned: 0 in 0.710s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:49 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7" released by "delete_volume" :: held 1.699s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:44:49 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Created reservations ['6e8c3205-5fa4-4284-8308-e856449b03a6', '3d44ad15-06a1-4ef7-aa19-bbfcfed480c6', '2374805b-7af6-4677-bb09-18578e81ca61', '34a63023-a2d1-4cf7-81ec-cb6654bf7dae'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:44:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:44:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:44:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:44:49 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:44:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:44:49 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:49 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:44:49 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "cinder-d5e99395-f2ef-4989-b2f4-dee58e61f14b-delete_volume" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:44:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-d5e99395-f2ef-4989-b2f4-dee58e61f14b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:44:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "cinder-quobyte-d5e99395-f2ef-4989-b2f4-dee58e61f14b" by "delete_volume" {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 16:44:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-d5e99395-f2ef-4989-b2f4-dee58e61f14b" acquired by "delete_volume" :: waited 0.020s {{(pid=86659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 16:44:50 devstack cinder-volume[86659]: DEBUG oslo.privsep.daemon [-] privsep: reply[036dfb9e-fa15-4e34-acd4-5229ad8f8682]: (4, 'qcow2') {{(pid=87851) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 16:44:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:50 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b Jul 03 16:44:50 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:50 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:50 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.765s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:50 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:44:50 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Deleted volume successfully. Jul 03 16:44:50 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-d45fafd2-d336-439a-aa6b-ad427955d317 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-0a40e0a2-578b-40b7-8fa4-9cb90e4386e7-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:44:51 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b" returned: 0 in 0.896s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:51 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b Jul 03 16:44:51 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:51 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406/volume-d5e99395-f2ef-4989-b2f4-dee58e61f14b" returned: 0 in 0.714s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-quobyte-d5e99395-f2ef-4989-b2f4-dee58e61f14b" released by "delete_volume" :: held 1.657s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG cinder.quota [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Created reservations ['e0cc6f36-784e-466e-b6b6-f68e1bbfb6b7', 'efa97eab-ff64-4584-8e71-1e4129a7ff2a', '2cb40680-37c8-4ea2-821b-1e8b5d92b777', '80fe9fde-45a6-48f5-a60c-f38df47fcad1'] {{(pid=86659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:44:51 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:44:51 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:44:51 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:44:52 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Jul 03 16:44:52 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.789s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:44:52 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:44:52 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Deleted volume successfully. Jul 03 16:44:52 devstack cinder-volume[86659]: DEBUG cinder.coordination [None req-b66e99e3-6e14-4ce0-9444-2f36b87bd782 tempest-SnapshotDependencyTests-123431467 None] Lock "cinder-d5e99395-f2ef-4989-b2f4-dee58e61f14b-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=86659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 16:45:01 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:UPDATE=28,cinder:SELECT=20,cinder:DELETE=3,cinder:INSERT=9 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:45:02 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 16:45:18 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:45:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 16:45:18 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 16:45:18 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 16:45:19 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43970168-764e-4bfa-9c3f-7b6430ab1816'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 16:45:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 16:45:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 16:45:19 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406 Jul 03 16:45:19 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 16:45:19 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Jul 03 16:45:19 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7917cfcfb34411d54b1707491b45d406" returned: 0 in 0.716s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 16:45:19 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 16:45:19 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 16:45:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread count: 28 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 16:45:19 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-e0bb53ed-8dbc-4689-bdb0-1c9798f4f125 None None] thread info: [<_MainThread(MainThread, started 129084158894208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}